[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:34:40 dist-test-slave-5k54 krb5kdc[13875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:34:40 dist-test-slave-5k54 krb5kdc[13875](info): set up 2 sockets
Aug 10 18:34:40 dist-test-slave-5k54 krb5kdc[13875](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 18:34:41.177006 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.002s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:34:41 dist-test-slave-5k54 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:34:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:34:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:34:41.372881 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37081
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:37081
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:41.740713 13889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:41.741106 13889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:41.741279 13889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:41.748948 13889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:34:41.749063 13889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:41.749197 13889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:41.749312 13889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:34:41.749403 13889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:34:41.760437 13889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:37081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:41.762487 13889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:41.764479 13889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:41.787714 13896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:41.788606 13899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:41.788653 13895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:41.789351 13889 server_base.cc:1034] running on GCE node
I20260810 18:34:41.790455 13889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:41.792724 13889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:41.794083 13889 hybrid_clock.cc:648] HybridClock initialized: now 1786386881794017 us; error 90 us; skew 500 ppm
I20260810 18:34:41.794611 13889 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:41 dist-test-slave-5k54 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386881, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:41.798243 13889 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:34:41.800643 13889 webserver.cc:460] Webserver started at http://127.13.139.62:44507/ using document root <none> and password file <none>
I20260810 18:34:41.801685 13889 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:41.801844 13889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:41.802302 13889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:41.806475 13889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "ee297ec45ca54e008512bc3e422c595b"
format_stamp: "Formatted at 2026-08-10 18:34:41 on dist-test-slave-5k54"
server_key: "8d4fbb5587da7b54371eb918eff5cd92"
server_key_iv: "c1ecbdd8343e4b0e9a2bf922ded66d0d"
server_key_version: "encryptionkey@0"
I20260810 18:34:41.807677 13889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "ee297ec45ca54e008512bc3e422c595b"
format_stamp: "Formatted at 2026-08-10 18:34:41 on dist-test-slave-5k54"
server_key: "8d4fbb5587da7b54371eb918eff5cd92"
server_key_iv: "c1ecbdd8343e4b0e9a2bf922ded66d0d"
server_key_version: "encryptionkey@0"
I20260810 18:34:41.815331 13889 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260810 18:34:41.820850 13910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:41.822925 13889 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
I20260810 18:34:41.823338 13889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "ee297ec45ca54e008512bc3e422c595b"
format_stamp: "Formatted at 2026-08-10 18:34:41 on dist-test-slave-5k54"
server_key: "8d4fbb5587da7b54371eb918eff5cd92"
server_key_iv: "c1ecbdd8343e4b0e9a2bf922ded66d0d"
server_key_version: "encryptionkey@0"
I20260810 18:34:41.823626 13889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:41.841709 13889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:41.846901 13889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:41.847256 13889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:41.870263 13889 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:37081
I20260810 18:34:41.870289 13971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:37081 every 8 connection(s)
I20260810 18:34:41.872903 13889 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:34:41.873996 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 13889
I20260810 18:34:41.874424 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:34:41.876766 13868 external_mini_cluster.cc:1428] Setting key a765917fadf0517e1d349332c5dfe7b8
I20260810 18:34:41.880545 13972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:41.900454 13972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b: Bootstrap starting.
I20260810 18:34:41.907449 13972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:41.909639 13972 log.cc:824] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b: Log is configured to *not* fsync() on all Append() calls
Aug 10 18:34:41 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:41.913784 13972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b: No bootstrap required, opened a new log
I20260810 18:34:41.926273 13976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:41.885506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43782 (local address 127.13.139.62:37081)
0810 18:34:41.887818 (+ 2312us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:41.887835 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:41.887892 (+ 57us) server_negotiation.cc:407] Connection header received
0810 18:34:41.897448 (+ 9556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:41.897477 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:41.898309 (+ 832us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:41.898927 (+ 618us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:41.901966 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:41.904936 (+ 2970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:41.907415 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:41.908803 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:41.909130 (+ 327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:41.915134 (+ 6004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:41.915205 (+ 71us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:41.915251 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:41.915306 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:41.919847 (+ 4541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:41.920745 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:41.920754 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:41.920761 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:41.921032 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:41.921474 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:41.921479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:41.921483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:41.922436 (+ 953us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:41.922819 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:41.923770 (+ 951us) server_negotiation.cc:299] Negotiation successful
0810 18:34:41.924230 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1919,"thread_start_us":1582,"threads_started":1}
I20260810 18:34:41.926816 13972 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee297ec45ca54e008512bc3e422c595b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37081 } }
I20260810 18:34:41.927452 13972 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:41.927698 13972 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee297ec45ca54e008512bc3e422c595b, State: Initialized, Role: FOLLOWER
I20260810 18:34:41.929066 13972 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee297ec45ca54e008512bc3e422c595b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37081 } }
I20260810 18:34:41.929522 13972 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:34:41.929898 13972 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:34:41.930212 13972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:41.934087 13972 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee297ec45ca54e008512bc3e422c595b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37081 } }
I20260810 18:34:41.934947 13972 leader_election.cc:302] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee297ec45ca54e008512bc3e422c595b; no voters:
I20260810 18:34:41.935703 13972 leader_election.cc:288] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:34:41.935930 13978 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:41.936626 13978 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [term 1 LEADER]: Becoming Leader. State: Replica: ee297ec45ca54e008512bc3e422c595b, State: Running, Role: LEADER
I20260810 18:34:41.937364 13978 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee297ec45ca54e008512bc3e422c595b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37081 } }
I20260810 18:34:41.938695 13972 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:34:41.942647 13979 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee297ec45ca54e008512bc3e422c595b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee297ec45ca54e008512bc3e422c595b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37081 } } }
I20260810 18:34:41.942761 13980 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee297ec45ca54e008512bc3e422c595b. Latest consensus state: current_term: 1 leader_uuid: "ee297ec45ca54e008512bc3e422c595b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee297ec45ca54e008512bc3e422c595b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37081 } } }
I20260810 18:34:41.943078 13979 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:41.943135 13980 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:41.946976 13987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:34:41.954356 13987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:34:41.968072 13987 catalog_manager.cc:1347] Generated new cluster ID: ec88b603299d4c26aaa66eb2093009ce
I20260810 18:34:41.968204 13987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:34:41.984054 13987 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:34:41.985621 13987 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:34:41.996340 13987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee297ec45ca54e008512bc3e422c595b: Generated new TSK 0
I20260810 18:34:41.997435 13987 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:34:42.056336 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37081
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:42.399473 14002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:42.399770 14002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:42.399953 14002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:42.407301 14002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:42.407421 14002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:42.407675 14002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:34:42.417851 14002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37081
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:42.419224 14002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:42.420657 14002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:42.435218 14008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:42.435185 14009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:42.435802 14011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:42.436092 14002 server_base.cc:1034] running on GCE node
I20260810 18:34:42.436724 14002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:42.437707 14002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:42.438936 14002 hybrid_clock.cc:648] HybridClock initialized: now 1786386882438861 us; error 68 us; skew 500 ppm
I20260810 18:34:42.439291 14002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:42 dist-test-slave-5k54 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386882, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:42.442868 14002 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:34:42.444453 14002 webserver.cc:460] Webserver started at http://127.13.139.1:35151/ using document root <none> and password file <none>
I20260810 18:34:42.445276 14002 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:42.445429 14002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:42.445757 14002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:42.449019 14002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "d0c3b7f77bb140a4badfbf18a97ec32f"
format_stamp: "Formatted at 2026-08-10 18:34:42 on dist-test-slave-5k54"
server_key: "df572aa7aa013810222f7569ba638426"
server_key_iv: "6b2a78f84807054ab5aefe533972f687"
server_key_version: "encryptionkey@0"
I20260810 18:34:42.449795 14002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "d0c3b7f77bb140a4badfbf18a97ec32f"
format_stamp: "Formatted at 2026-08-10 18:34:42 on dist-test-slave-5k54"
server_key: "df572aa7aa013810222f7569ba638426"
server_key_iv: "6b2a78f84807054ab5aefe533972f687"
server_key_version: "encryptionkey@0"
I20260810 18:34:42.455091 14002 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260810 18:34:42.459033 14019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:42.460472 14002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 18:34:42.460668 14002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "d0c3b7f77bb140a4badfbf18a97ec32f"
format_stamp: "Formatted at 2026-08-10 18:34:42 on dist-test-slave-5k54"
server_key: "df572aa7aa013810222f7569ba638426"
server_key_iv: "6b2a78f84807054ab5aefe533972f687"
server_key_version: "encryptionkey@0"
I20260810 18:34:42.460886 14002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:42.479382 14002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:42.483397 14002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:42.483811 14002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:42.484905 14002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:34:42.486742 14002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:42.486871 14002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:42.487098 14002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:42.487185 14002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:42.524355 14002 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:41833
I20260810 18:34:42.524410 14144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:41833 every 8 connection(s)
I20260810 18:34:42.525671 14002 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:34:42.536033 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 14002
I20260810 18:34:42.536275 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:34:42.536886 13868 external_mini_cluster.cc:1428] Setting key f57d008d802b123a08055f439049ae0c
Aug 10 18:34:42 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386882, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:42.548622 14148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:42.528960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:41811 (local address 127.13.139.62:37081)
0810 18:34:42.529442 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:42.529447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:42.530373 (+ 926us) server_negotiation.cc:407] Connection header received
0810 18:34:42.532360 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:42.532366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:42.532474 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:42.532601 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:42.534189 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:42.534902 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:42.536697 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:42.537169 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:42.537306 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:42.541375 (+ 4069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:42.541385 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:42.541392 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:42.541439 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:42.545338 (+ 3899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:42.546092 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:42.546098 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:42.546101 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:42.546279 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:42.546726 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:42.546731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:42.546735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:42.547009 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:42.547167 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:42.547977 (+ 810us) server_negotiation.cc:299] Negotiation successful
0810 18:34:42.548197 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":270,"threads_started":1}
I20260810 18:34:42.549562 14149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:42.529440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37081 (local address 127.13.139.1:41811)
0810 18:34:42.530202 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:42.530240 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:42.532043 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:42.532857 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:42.532866 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:42.533409 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:42.534000 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:42.534019 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:42.535095 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:42.535101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:42.536549 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:42.536562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:42.537418 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:42.537425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:42.537661 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:42.538372 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:42.538400 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:42.541139 (+ 2739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:42.545471 (+ 4332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:42.545477 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:42.545490 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:42.545961 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:42.546394 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:42.546401 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:42.546406 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:42.546604 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:42.547141 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:42.547149 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:42.547550 (+ 401us) client_negotiation.cc:769] Sending connection context
0810 18:34:42.547866 (+ 316us) client_negotiation.cc:240] Negotiation successful
0810 18:34:42.548399 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":307,"threads_started":1}
I20260810 18:34:42.551461 14145 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37081
I20260810 18:34:42.551971 14145 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:42.552835 14145 heartbeater.cc:511] Master 127.13.139.62:37081 requested a full tablet report, sending...
I20260810 18:34:42.557395 13929 ts_manager.cc:194] Registered new tserver with Master: d0c3b7f77bb140a4badfbf18a97ec32f (127.13.139.1:41833)
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:34:42.559998 13929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:41811
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:34:42.587256 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37081
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:42.945178 14152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:42.945499 14152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:42.945673 14152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:42.953121 14152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:42.953284 14152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:42.953475 14152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:34:42.963821 14152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37081
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:42.965516 14152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:42.966912 14152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:42.981388 14157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:42.981351 14160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:42.981473 14158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:42.982105 14152 server_base.cc:1034] running on GCE node
I20260810 18:34:42.982726 14152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:42.983805 14152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:42.985044 14152 hybrid_clock.cc:648] HybridClock initialized: now 1786386882984996 us; error 45 us; skew 500 ppm
I20260810 18:34:42.985373 14152 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:42 dist-test-slave-5k54 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386882, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:42.988736 14152 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:34:42.990306 14152 webserver.cc:460] Webserver started at http://127.13.139.2:37955/ using document root <none> and password file <none>
I20260810 18:34:42.991011 14152 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:42.991186 14152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:42.991603 14152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:42.994781 14152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "3c59a34a67a245608292b844d0597161"
format_stamp: "Formatted at 2026-08-10 18:34:42 on dist-test-slave-5k54"
server_key: "8db8f3c7bd02c72b8db26e0db3904c28"
server_key_iv: "99e4f028b930e1e607cf2f3e5762942b"
server_key_version: "encryptionkey@0"
I20260810 18:34:42.995669 14152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "3c59a34a67a245608292b844d0597161"
format_stamp: "Formatted at 2026-08-10 18:34:42 on dist-test-slave-5k54"
server_key: "8db8f3c7bd02c72b8db26e0db3904c28"
server_key_iv: "99e4f028b930e1e607cf2f3e5762942b"
server_key_version: "encryptionkey@0"
I20260810 18:34:43.001102 14152 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:34:43.004729 14168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:43.006112 14152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:34:43.006304 14152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "3c59a34a67a245608292b844d0597161"
format_stamp: "Formatted at 2026-08-10 18:34:42 on dist-test-slave-5k54"
server_key: "8db8f3c7bd02c72b8db26e0db3904c28"
server_key_iv: "99e4f028b930e1e607cf2f3e5762942b"
server_key_version: "encryptionkey@0"
I20260810 18:34:43.006524 14152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:43.029333 14152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:43.033931 14152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:43.034243 14152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:43.035634 14152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:34:43.037117 14152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:43.037240 14152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:43.037369 14152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:43.037463 14152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:43.077653 14152 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:39625
I20260810 18:34:43.077711 14296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:39625 every 8 connection(s)
I20260810 18:34:43.078975 14152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:34:43.086274 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 14152
I20260810 18:34:43.086486 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:34:43.086935 13868 external_mini_cluster.cc:1428] Setting key a792d9ed9728ed01a798442799ba6602
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386882, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:43.100123 14299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.081908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:40059 (local address 127.13.139.62:37081)
0810 18:34:43.082355 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:43.082360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:43.083551 (+ 1191us) server_negotiation.cc:407] Connection header received
0810 18:34:43.085505 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:43.085512 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:43.085612 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:43.085735 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:43.087491 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.088353 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.090048 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.090483 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.090615 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.094158 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:43.094163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:43.094166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:43.094198 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:43.097077 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.097815 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.097822 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.097825 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.097967 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.098384 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.098390 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.098393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.098660 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:43.098816 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:43.099514 (+ 698us) server_negotiation.cc:299] Negotiation successful
0810 18:34:43.099738 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":233,"threads_started":1}
I20260810 18:34:43.101119 14300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.082547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37081 (local address 127.13.139.2:40059)
0810 18:34:43.083275 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:43.083321 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:43.085213 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:43.085994 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:43.086003 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:43.086665 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:43.087290 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:43.087308 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.088524 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.088528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:43.089893 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:43.089905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.090713 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.090720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:43.090973 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.091692 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:43.091714 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:43.093932 (+ 2218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:43.097226 (+ 3294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:43.097235 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:43.097250 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:43.097693 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:43.098081 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:43.098086 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:43.098090 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:43.098271 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:43.098790 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:43.098798 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:43.099141 (+ 343us) client_negotiation.cc:769] Sending connection context
0810 18:34:43.099410 (+ 269us) client_negotiation.cc:240] Negotiation successful
0810 18:34:43.099963 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":289,"threads_started":1}
I20260810 18:34:43.102690 14297 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37081
I20260810 18:34:43.103024 14297 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:43.103868 14297 heartbeater.cc:511] Master 127.13.139.62:37081 requested a full tablet report, sending...
I20260810 18:34:43.105441 13929 ts_manager.cc:194] Registered new tserver with Master: 3c59a34a67a245608292b844d0597161 (127.13.139.2:39625)
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
I20260810 18:34:43.106650 13929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:40059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:34:43.133123 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37081
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:43.476382 14303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:43.476712 14303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:43.476897 14303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:43.484643 14303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:43.484884 14303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:43.485083 14303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:34:43.495710 14303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37081
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:43.497046 14303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:43.498440 14303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:43.512068 14313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:43.512111 14311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:43.512033 14310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:43.514153 14303 server_base.cc:1034] running on GCE node
I20260810 18:34:43.514750 14303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:43.515853 14303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:43.517112 14303 hybrid_clock.cc:648] HybridClock initialized: now 1786386883517060 us; error 51 us; skew 500 ppm
I20260810 18:34:43.517467 14303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:43.520864 14303 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:34:43.522500 14303 webserver.cc:460] Webserver started at http://127.13.139.3:38347/ using document root <none> and password file <none>
I20260810 18:34:43.523253 14303 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:43.523412 14303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:43.523833 14303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:43.526971 14303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "1c07538352e84d608a9f3b5c999c19ba"
format_stamp: "Formatted at 2026-08-10 18:34:43 on dist-test-slave-5k54"
server_key: "80ebb0e9c4b608a93ae767a906fbe9d5"
server_key_iv: "331e8011b22b42079bf6e8c0ae750b8c"
server_key_version: "encryptionkey@0"
I20260810 18:34:43.527796 14303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "1c07538352e84d608a9f3b5c999c19ba"
format_stamp: "Formatted at 2026-08-10 18:34:43 on dist-test-slave-5k54"
server_key: "80ebb0e9c4b608a93ae767a906fbe9d5"
server_key_iv: "331e8011b22b42079bf6e8c0ae750b8c"
server_key_version: "encryptionkey@0"
I20260810 18:34:43.533361 14303 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260810 18:34:43.536895 14320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:43.538136 14303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260810 18:34:43.538305 14303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "1c07538352e84d608a9f3b5c999c19ba"
format_stamp: "Formatted at 2026-08-10 18:34:43 on dist-test-slave-5k54"
server_key: "80ebb0e9c4b608a93ae767a906fbe9d5"
server_key_iv: "331e8011b22b42079bf6e8c0ae750b8c"
server_key_version: "encryptionkey@0"
I20260810 18:34:43.538533 14303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:43.557001 14303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:43.560992 14303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:43.561292 14303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:43.562289 14303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:34:43.563712 14303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:43.563787 14303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:43.563951 14303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:43.564007 14303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:43.564808 14145 heartbeater.cc:503] Master 127.13.139.62:37081 was elected leader, sending a full tablet report...
I20260810 18:34:43.602232 14303 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:37985
I20260810 18:34:43.602339 14441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:37985 every 8 connection(s)
I20260810 18:34:43.603628 14303 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:34:43.613029 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 14303
I20260810 18:34:43.613241 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:34:43.613693 13868 external_mini_cluster.cc:1428] Setting key aac19ac3ee9c228310cd4d832cd1c3ff
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:43.624442 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.606472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:49381 (local address 127.13.139.62:37081)
0810 18:34:43.606904 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:43.606909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:43.608204 (+ 1295us) server_negotiation.cc:407] Connection header received
0810 18:34:43.610275 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:43.610281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:43.610360 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:43.610458 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:43.612178 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.612965 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.614807 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.615379 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.615566 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.619024 (+ 3458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:43.619028 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:43.619031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:43.619062 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:43.621816 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.622459 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.622462 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.622465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.622585 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.622969 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.622972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.622974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.623215 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:43.623329 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:43.624006 (+ 677us) server_negotiation.cc:299] Negotiation successful
0810 18:34:43.624164 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":224,"threads_started":1}
I20260810 18:34:43.625450 14445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.607095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37081 (local address 127.13.139.3:49381)
0810 18:34:43.608025 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:43.608096 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:43.609931 (+ 1835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:43.610698 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:43.610706 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:43.611359 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:43.612030 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:43.612048 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.613163 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.613167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:43.614637 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:43.614654 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.615641 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.615646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:43.615846 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.616580 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:43.616607 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:43.618833 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:43.621931 (+ 3098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:43.621938 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:43.621948 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:43.622354 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:43.622683 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:43.622686 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:43.622689 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:43.622862 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:43.623321 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:43.623326 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:43.623689 (+ 363us) client_negotiation.cc:769] Sending connection context
0810 18:34:43.623919 (+ 230us) client_negotiation.cc:240] Negotiation successful
0810 18:34:43.624288 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":355,"threads_started":1}
I20260810 18:34:43.626766 14442 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37081
I20260810 18:34:43.627068 14442 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:43.627915 14442 heartbeater.cc:511] Master 127.13.139.62:37081 requested a full tablet report, sending...
I20260810 18:34:43.629377 13929 ts_manager.cc:194] Registered new tserver with Master: 1c07538352e84d608a9f3b5c999c19ba (127.13.139.3:37985)
I20260810 18:34:43.630250 13929 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:49381
I20260810 18:34:43.630352 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:34:43.683576 14450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.667410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51038 (local address 127.13.139.1:41833)
0810 18:34:43.668164 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:43.668173 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:43.668209 (+ 36us) server_negotiation.cc:407] Connection header received
0810 18:34:43.668286 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:43.668300 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:43.668523 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:43.668783 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:43.670419 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.671415 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.672804 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.673387 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.673542 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.677834 (+ 4292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:43.677845 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:43.677859 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:43.677904 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:43.680672 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.681368 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.681376 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.681378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.681501 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.681913 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.681919 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.681923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.682248 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:43.682595 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:43.682874 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 18:34:43.683142 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":356,"threads_started":1}
W20260810 18:34:43.685075 14048 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51038
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:34:43.735168 14450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.721665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51048 (local address 127.13.139.1:41833)
0810 18:34:43.721908 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:43.721914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:43.722153 (+ 239us) server_negotiation.cc:407] Connection header received
0810 18:34:43.722278 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:43.722282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:43.722361 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:43.722441 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:43.723879 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.724581 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.725815 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.726260 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.726355 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.730322 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:43.730327 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:43.730330 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:43.730366 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:43.732933 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.733520 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.733523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.733526 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.733647 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.733952 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.733955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.733957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.734205 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:43.734382 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:43.734628 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 18:34:43.734793 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260810 18:34:43.737180 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 14002
I20260810 18:34:43.750746 14450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.738244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51054 (local address 127.13.139.1:41833)
0810 18:34:43.738464 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:43.738473 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:43.738807 (+ 334us) server_negotiation.cc:407] Connection header received
0810 18:34:43.738927 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:43.738931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:43.738986 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:43.739072 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:43.740403 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.741230 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.742750 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.743222 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.743357 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.745639 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:43.745645 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:43.745650 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:43.745688 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:43.748140 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.748804 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.748809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.748813 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.748953 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.749354 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.749360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.749363 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.749616 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:43.749877 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:43.750178 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 18:34:43.750381 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:34:43.751664 14140 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:43.841717 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 14002
I20260810 18:34:43.860491 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 14152
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:34:43.876890 14457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.861500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55070 (local address 127.13.139.2:39625)
0810 18:34:43.862072 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:43.862078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:43.862105 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:34:43.862173 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:43.862179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:43.862385 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:43.862523 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:43.863704 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.864681 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.865864 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.866387 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.866479 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.870804 (+ 4325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:43.870816 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:43.870830 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:43.870864 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:43.873777 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.874457 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.874464 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.874467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.874602 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.875043 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.875050 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.875057 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.875405 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:43.875937 (+ 532us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:43.876255 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 18:34:43.876531 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":294,"threads_started":1}
I20260810 18:34:43.878173 14292 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:43.960824 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 14152
I20260810 18:34:43.979421 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 14303
Aug 10 18:34:43 dist-test-slave-5k54 krb5kdc[13875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:34:43.995575 14460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:43.980513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40870 (local address 127.13.139.3:37985)
0810 18:34:43.981173 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:43.981181 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:43.981209 (+ 28us) server_negotiation.cc:407] Connection header received
0810 18:34:43.981273 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:43.981280 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:43.981484 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:43.981610 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:43.982845 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.984000 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.985253 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:43.985792 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:43.985888 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:43.990048 (+ 4160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:43.990060 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:43.990075 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:43.990114 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:43.992919 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.993608 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.993615 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.993617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.993739 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:43.994083 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:43.994086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:43.994088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:43.994422 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:43.994652 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:43.994895 (+ 243us) server_negotiation.cc:299] Negotiation successful
0810 18:34:43.995108 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":347,"threads_started":1}
I20260810 18:34:43.996904 14437 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:44.080479 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 14303
I20260810 18:34:44.099748 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 13889
I20260810 18:34:44.100927 13967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:44.207736 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 13889
2026-08-10T18:34:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4238 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:34:44 dist-test-slave-5k54 krb5kdc[14465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:34:44 dist-test-slave-5k54 krb5kdc[14465](info): set up 2 sockets
Aug 10 18:34:44 dist-test-slave-5k54 krb5kdc[14465](info): commencing operation
krb5kdc: starting...
W20260810 18:34:45.382417 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:34:45 dist-test-slave-5k54 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:34:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:34:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:34:45.575273 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:38327
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:38327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:45.897306 14480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:45.897655 14480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:45.897812 14480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:45.905612 14480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:34:45.905717 14480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:45.905822 14480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:45.905930 14480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:34:45.905998 14480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:34:45.916126 14480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:38327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:38327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:45.917447 14480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:45.918777 14480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:45.930668 14486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:45.930636 14487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:45.930886 14489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:45.931463 14480 server_base.cc:1034] running on GCE node
I20260810 18:34:45.932271 14480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:45.933596 14480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:45.934801 14480 hybrid_clock.cc:648] HybridClock initialized: now 1786386885934760 us; error 33 us; skew 500 ppm
I20260810 18:34:45.935149 14480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:45 dist-test-slave-5k54 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386885, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:45.943856 14480 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:34:45.945569 14480 webserver.cc:460] Webserver started at http://127.13.139.62:34789/ using document root <none> and password file <none>
I20260810 18:34:45.946300 14480 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:45.946439 14480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:45.946792 14480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:45.949865 14480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "970768d898c74e168f14dc8deb955cbf"
format_stamp: "Formatted at 2026-08-10 18:34:45 on dist-test-slave-5k54"
server_key: "5c05ff26e91a3d8b8c21258aae3e4f0f"
server_key_iv: "8c5c3effc47b8c928728236fc54b1b92"
server_key_version: "encryptionkey@0"
I20260810 18:34:45.950641 14480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "970768d898c74e168f14dc8deb955cbf"
format_stamp: "Formatted at 2026-08-10 18:34:45 on dist-test-slave-5k54"
server_key: "5c05ff26e91a3d8b8c21258aae3e4f0f"
server_key_iv: "8c5c3effc47b8c928728236fc54b1b92"
server_key_version: "encryptionkey@0"
I20260810 18:34:45.955854 14480 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260810 18:34:45.959298 14496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:45.960665 14480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:34:45.960860 14480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "970768d898c74e168f14dc8deb955cbf"
format_stamp: "Formatted at 2026-08-10 18:34:45 on dist-test-slave-5k54"
server_key: "5c05ff26e91a3d8b8c21258aae3e4f0f"
server_key_iv: "8c5c3effc47b8c928728236fc54b1b92"
server_key_version: "encryptionkey@0"
I20260810 18:34:45.961069 14480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:45.992195 14480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:45.996277 14480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:45.996686 14480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:46.015511 14480 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:38327
I20260810 18:34:46.015482 14552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:38327 every 8 connection(s)
I20260810 18:34:46.016906 14480 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:34:46.020748 14553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:46.023770 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 14480
I20260810 18:34:46.024022 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:34:46.024912 13868 external_mini_cluster.cc:1428] Setting key 762fd50cc33017a1a60b0fa084146525
I20260810 18:34:46.033847 14553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf: Bootstrap starting.
I20260810 18:34:46.037830 14553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:46.039206 14553 log.cc:824] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf: Log is configured to *not* fsync() on all Append() calls
Aug 10 18:34:46 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:46.042340 14553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf: No bootstrap required, opened a new log
I20260810 18:34:46.049032 14557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:46.027119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49698 (local address 127.13.139.62:38327)
0810 18:34:46.027925 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:46.027937 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:46.027979 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:34:46.029656 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:46.029678 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:46.030071 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:46.030425 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:46.032368 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:46.033662 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:46.035340 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:46.036077 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:46.036204 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:46.041309 (+ 5105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:46.041317 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:46.041331 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:46.041363 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:46.044625 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:46.045458 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:46.045464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:46.045470 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:46.045631 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:46.046112 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:46.046116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:46.046118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:46.046674 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:46.046915 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:46.047588 (+ 673us) server_negotiation.cc:299] Negotiation successful
0810 18:34:46.047992 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":387,"threads_started":1}
I20260810 18:34:46.051723 14553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970768d898c74e168f14dc8deb955cbf" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38327 } }
I20260810 18:34:46.052196 14553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:46.052304 14553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 970768d898c74e168f14dc8deb955cbf, State: Initialized, Role: FOLLOWER
I20260810 18:34:46.052928 14553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970768d898c74e168f14dc8deb955cbf" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38327 } }
I20260810 18:34:46.053181 14553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:34:46.053309 14553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:34:46.053483 14553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:46.055929 14553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970768d898c74e168f14dc8deb955cbf" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38327 } }
I20260810 18:34:46.056489 14553 leader_election.cc:302] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 970768d898c74e168f14dc8deb955cbf; no voters:
I20260810 18:34:46.057132 14553 leader_election.cc:288] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:34:46.057272 14559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:46.057962 14559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [term 1 LEADER]: Becoming Leader. State: Replica: 970768d898c74e168f14dc8deb955cbf, State: Running, Role: LEADER
I20260810 18:34:46.058449 14559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970768d898c74e168f14dc8deb955cbf" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38327 } }
I20260810 18:34:46.059195 14553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:34:46.061568 14560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "970768d898c74e168f14dc8deb955cbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970768d898c74e168f14dc8deb955cbf" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38327 } } }
I20260810 18:34:46.062112 14560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:46.061568 14561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 970768d898c74e168f14dc8deb955cbf. Latest consensus state: current_term: 1 leader_uuid: "970768d898c74e168f14dc8deb955cbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970768d898c74e168f14dc8deb955cbf" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38327 } } }
I20260810 18:34:46.067853 14561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:46.071359 14568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:34:46.076973 14568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:34:46.085705 14568 catalog_manager.cc:1347] Generated new cluster ID: 2f1a62d21e5f42bb9265a1195ae1e183
I20260810 18:34:46.085814 14568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:34:46.102779 14568 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:34:46.104190 14568 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:34:46.113363 14568 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 970768d898c74e168f14dc8deb955cbf: Generated new TSK 0
I20260810 18:34:46.114200 14568 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:34:46.172963 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38327
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:46.508845 14581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:46.509131 14581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:46.509258 14581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:46.516770 14581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:46.516885 14581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:46.517055 14581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:34:46.527195 14581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38327
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:46.528806 14581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:46.530215 14581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:46.543630 14587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:46.543752 14590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:46.544186 14586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:46.544278 14581 server_base.cc:1034] running on GCE node
I20260810 18:34:46.545023 14581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:46.545951 14581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:46.547169 14581 hybrid_clock.cc:648] HybridClock initialized: now 1786386886547108 us; error 55 us; skew 500 ppm
I20260810 18:34:46.547546 14581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:46 dist-test-slave-5k54 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386886, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:46.550777 14581 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:34:46.552321 14581 webserver.cc:460] Webserver started at http://127.13.139.1:42681/ using document root <none> and password file <none>
I20260810 18:34:46.553005 14581 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:46.553143 14581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:46.553462 14581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:46.556416 14581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "a92ea75fb44b430a8c624efa8ef56ff7"
format_stamp: "Formatted at 2026-08-10 18:34:46 on dist-test-slave-5k54"
server_key: "226988a0493dcceaafb1d632730afe60"
server_key_iv: "138067841de83fa470db2609e84923a0"
server_key_version: "encryptionkey@0"
I20260810 18:34:46.557201 14581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "a92ea75fb44b430a8c624efa8ef56ff7"
format_stamp: "Formatted at 2026-08-10 18:34:46 on dist-test-slave-5k54"
server_key: "226988a0493dcceaafb1d632730afe60"
server_key_iv: "138067841de83fa470db2609e84923a0"
server_key_version: "encryptionkey@0"
I20260810 18:34:46.562253 14581 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:34:46.565814 14597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:46.567176 14581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:34:46.567339 14581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "a92ea75fb44b430a8c624efa8ef56ff7"
format_stamp: "Formatted at 2026-08-10 18:34:46 on dist-test-slave-5k54"
server_key: "226988a0493dcceaafb1d632730afe60"
server_key_iv: "138067841de83fa470db2609e84923a0"
server_key_version: "encryptionkey@0"
I20260810 18:34:46.567607 14581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:46.594606 14581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:46.599471 14581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:46.599786 14581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:46.600761 14581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:34:46.602087 14581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:46.602160 14581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:46.602310 14581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:46.602376 14581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:46.636507 14581 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:45163
I20260810 18:34:46.636559 14717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:45163 every 8 connection(s)
I20260810 18:34:46.637830 14581 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:34:46.643646 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 14581
I20260810 18:34:46.643875 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:34:46.644739 13868 external_mini_cluster.cc:1428] Setting key 0843a28a6317e6c0859bfc185920d44a
Aug 10 18:34:46 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386886, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:46.662390 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:46.640528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:53259 (local address 127.13.139.62:38327)
0810 18:34:46.640987 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:46.640992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:46.641973 (+ 981us) server_negotiation.cc:407] Connection header received
0810 18:34:46.644307 (+ 2334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:46.644312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:46.644380 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:46.644478 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:46.646445 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:46.647317 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:46.649978 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:46.650616 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:46.650743 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:46.655503 (+ 4760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:46.655513 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:46.655520 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:46.655566 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:46.659155 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:46.659950 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:46.659958 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:46.659965 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:46.660144 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:46.660590 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:46.660595 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:46.660599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:46.660871 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:46.661048 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:46.661791 (+ 743us) server_negotiation.cc:299] Negotiation successful
0810 18:34:46.662028 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":223,"threads_started":1}
I20260810 18:34:46.663592 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:46.641097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38327 (local address 127.13.139.1:53259)
0810 18:34:46.641812 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:46.641850 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:46.643998 (+ 2148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:46.644832 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:46.644846 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:46.645563 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:46.646267 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:46.646285 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:46.647512 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:46.647528 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:46.649789 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:46.649816 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:46.650857 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:46.650866 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:46.651205 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:46.652071 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:46.652106 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:46.655263 (+ 3157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:46.659292 (+ 4029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:46.659299 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:46.659312 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:46.659810 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:46.660264 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:46.660267 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:46.660269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:46.660446 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:46.661010 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:46.661019 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:46.661382 (+ 363us) client_negotiation.cc:769] Sending connection context
0810 18:34:46.661662 (+ 280us) client_negotiation.cc:240] Negotiation successful
0810 18:34:46.662205 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":273,"threads_started":1}
I20260810 18:34:46.665302 14718 heartbeater.cc:347] Connected to a master server at 127.13.139.62:38327
I20260810 18:34:46.665645 14718 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:34:46.666576 14718 heartbeater.cc:511] Master 127.13.139.62:38327 requested a full tablet report, sending...
I20260810 18:34:46.668848 14516 ts_manager.cc:194] Registered new tserver with Master: a92ea75fb44b430a8c624efa8ef56ff7 (127.13.139.1:45163)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
I20260810 18:34:46.670460 14516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:53259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:34:46.694684 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38327
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:47.020543 14724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:47.020807 14724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:47.020987 14724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:47.028352 14724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:47.028458 14724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:47.028632 14724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:34:47.038414 14724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38327
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:47.039714 14724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:47.041020 14724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:47.054484 14730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:47.054523 14731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:47.054571 14733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:47.055716 14724 server_base.cc:1034] running on GCE node
I20260810 18:34:47.056346 14724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:47.057309 14724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:47.058558 14724 hybrid_clock.cc:648] HybridClock initialized: now 1786386887058492 us; error 51 us; skew 500 ppm
I20260810 18:34:47.058966 14724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:47 dist-test-slave-5k54 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386887, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:47.062242 14724 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:34:47.063707 14724 webserver.cc:460] Webserver started at http://127.13.139.2:44019/ using document root <none> and password file <none>
I20260810 18:34:47.064424 14724 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:47.064581 14724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:47.064990 14724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:47.068634 14724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "01027909c50f4a91a06ff54834337ef4"
format_stamp: "Formatted at 2026-08-10 18:34:47 on dist-test-slave-5k54"
server_key: "0b08b6611ecf027a27fe67bdd93e008a"
server_key_iv: "1245a9972638e7e3145fef3b906ed84d"
server_key_version: "encryptionkey@0"
I20260810 18:34:47.069456 14724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "01027909c50f4a91a06ff54834337ef4"
format_stamp: "Formatted at 2026-08-10 18:34:47 on dist-test-slave-5k54"
server_key: "0b08b6611ecf027a27fe67bdd93e008a"
server_key_iv: "1245a9972638e7e3145fef3b906ed84d"
server_key_version: "encryptionkey@0"
I20260810 18:34:47.075255 14724 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 18:34:47.078967 14741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:47.080377 14724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:34:47.080586 14724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "01027909c50f4a91a06ff54834337ef4"
format_stamp: "Formatted at 2026-08-10 18:34:47 on dist-test-slave-5k54"
server_key: "0b08b6611ecf027a27fe67bdd93e008a"
server_key_iv: "1245a9972638e7e3145fef3b906ed84d"
server_key_version: "encryptionkey@0"
I20260810 18:34:47.080809 14724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:47.106429 14724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:47.110574 14724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:47.110894 14724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:47.111972 14724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:34:47.113395 14724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:47.113500 14724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:47.113641 14724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:47.113718 14724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:47.148139 14724 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:39995
I20260810 18:34:47.148187 14867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:39995 every 8 connection(s)
I20260810 18:34:47.149442 14724 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:34:47.154726 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 14724
I20260810 18:34:47.154927 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:34:47.155400 13868 external_mini_cluster.cc:1428] Setting key 21229c4b34e528500dd44d97f3142aa0
Aug 10 18:34:47 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386887, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:47.171350 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.152089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:60461 (local address 127.13.139.62:38327)
0810 18:34:47.152275 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.152280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.153482 (+ 1202us) server_negotiation.cc:407] Connection header received
0810 18:34:47.155478 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.155485 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.155598 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.155722 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:47.157455 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.158172 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.159884 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.160402 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.160543 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.164060 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:47.164065 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:47.164069 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:47.164099 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:47.167821 (+ 3722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:47.168816 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:47.168820 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:47.168822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:47.168952 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:47.169447 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:47.169450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:47.169452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:47.169701 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:47.169806 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.170912 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.171084 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:34:47.172950 14871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.152552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38327 (local address 127.13.139.2:60461)
0810 18:34:47.153312 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:47.153358 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:47.155177 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:47.156008 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:47.156030 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:47.156622 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:47.157291 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.157318 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.158359 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.158365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.159727 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.159744 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.160631 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.160639 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.160867 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.161577 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:47.161599 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:47.163829 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:47.167982 (+ 4153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:47.167993 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:47.168011 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:47.168698 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:47.169073 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:47.169081 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:47.169087 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:47.169332 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:47.169831 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:47.169841 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:47.170339 (+ 498us) client_negotiation.cc:769] Sending connection context
0810 18:34:47.170672 (+ 333us) client_negotiation.cc:240] Negotiation successful
0810 18:34:47.171251 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":348,"threads_started":1}
I20260810 18:34:47.174487 14869 heartbeater.cc:347] Connected to a master server at 127.13.139.62:38327
I20260810 18:34:47.174793 14869 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:47.175554 14869 heartbeater.cc:511] Master 127.13.139.62:38327 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
I20260810 18:34:47.177085 14516 ts_manager.cc:194] Registered new tserver with Master: 01027909c50f4a91a06ff54834337ef4 (127.13.139.2:39995)
I20260810 18:34:47.177985 14516 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:60461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:34:47.206648 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38327
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:47.534737 14874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:47.535023 14874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:47.535208 14874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:47.542434 14874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:47.542567 14874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:47.542768 14874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:34:47.552666 14874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38327
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:47.554076 14874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:47.555486 14874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:47.569275 14879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:47.569204 14880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:47.569250 14882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:47.570457 14874 server_base.cc:1034] running on GCE node
I20260810 18:34:47.571142 14874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:47.572316 14874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:47.573541 14874 hybrid_clock.cc:648] HybridClock initialized: now 1786386887573476 us; error 51 us; skew 500 ppm
I20260810 18:34:47.573881 14874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:47 dist-test-slave-5k54 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386887, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:47.577140 14874 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:34:47.578600 14874 webserver.cc:460] Webserver started at http://127.13.139.3:33643/ using document root <none> and password file <none>
I20260810 18:34:47.579620 14874 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:47.579777 14874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:47.580109 14874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:47.583067 14874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "b6906e155e1b48b38d7b9f40b1e47df9"
format_stamp: "Formatted at 2026-08-10 18:34:47 on dist-test-slave-5k54"
server_key: "8be35f79f347c640f4ef9ada3234b23b"
server_key_iv: "bba7b1be3acef6174854a76a270fc12e"
server_key_version: "encryptionkey@0"
I20260810 18:34:47.583997 14874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "b6906e155e1b48b38d7b9f40b1e47df9"
format_stamp: "Formatted at 2026-08-10 18:34:47 on dist-test-slave-5k54"
server_key: "8be35f79f347c640f4ef9ada3234b23b"
server_key_iv: "bba7b1be3acef6174854a76a270fc12e"
server_key_version: "encryptionkey@0"
I20260810 18:34:47.589426 14874 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260810 18:34:47.593061 14889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:47.594446 14874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:34:47.594635 14874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "b6906e155e1b48b38d7b9f40b1e47df9"
format_stamp: "Formatted at 2026-08-10 18:34:47 on dist-test-slave-5k54"
server_key: "8be35f79f347c640f4ef9ada3234b23b"
server_key_iv: "bba7b1be3acef6174854a76a270fc12e"
server_key_version: "encryptionkey@0"
I20260810 18:34:47.594853 14874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:47.622433 14874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:47.626643 14874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:47.626992 14874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:47.628038 14874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:34:47.629400 14874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:47.629513 14874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:47.629676 14874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:47.629753 14874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:47.666036 14874 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:37179
I20260810 18:34:47.666057 15019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:37179 every 8 connection(s)
I20260810 18:34:47.667511 14874 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:34:47.673578 14718 heartbeater.cc:503] Master 127.13.139.62:38327 was elected leader, sending a full tablet report...
I20260810 18:34:47.676038 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 14874
I20260810 18:34:47.676259 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:34:47.676714 13868 external_mini_cluster.cc:1428] Setting key a1c97553d96dec6adec5b0f0181e9811
Aug 10 18:34:47 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386887, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:47.688828 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.670288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:57963 (local address 127.13.139.62:38327)
0810 18:34:47.670468 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.670472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.671933 (+ 1461us) server_negotiation.cc:407] Connection header received
0810 18:34:47.674114 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.674119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.674215 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.674326 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:47.676169 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.677089 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.679228 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.679894 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.680047 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.683366 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:47.683370 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:47.683373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:47.683405 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:47.686207 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:47.686868 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:47.686871 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:47.686873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:47.686995 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:47.687356 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:47.687359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:47.687361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:47.687679 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:47.687788 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.688421 (+ 633us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.688589 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:34:47.689787 15022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.670857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38327 (local address 127.13.139.3:57963)
0810 18:34:47.671721 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:47.671794 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:47.673788 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:47.674571 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:47.674579 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:47.675086 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:47.675962 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.675991 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.677252 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.677258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.679091 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.679103 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.680106 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.680111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.680303 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.681000 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:47.681023 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:47.683189 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:47.686329 (+ 3140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:47.686335 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:47.686347 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:47.686763 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:47.687089 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:47.687092 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:47.687094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:47.687263 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:47.687785 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:47.687791 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:47.688106 (+ 315us) client_negotiation.cc:769] Sending connection context
0810 18:34:47.688329 (+ 223us) client_negotiation.cc:240] Negotiation successful
0810 18:34:47.688696 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":335,"threads_started":1}
I20260810 18:34:47.691390 15020 heartbeater.cc:347] Connected to a master server at 127.13.139.62:38327
I20260810 18:34:47.691726 15020 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:47.692513 15020 heartbeater.cc:511] Master 127.13.139.62:38327 requested a full tablet report, sending...
I20260810 18:34:47.693917 14515 ts_manager.cc:194] Registered new tserver with Master: b6906e155e1b48b38d7b9f40b1e47df9 (127.13.139.3:37179)
I20260810 18:34:47.694759 14515 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:57963
I20260810 18:34:47.704286 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:34:47.724591 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.711845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49712 (local address 127.13.139.62:38327)
0810 18:34:47.712037 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.712042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.712643 (+ 601us) server_negotiation.cc:407] Connection header received
0810 18:34:47.712774 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.712778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.712879 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.712966 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:47.714430 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.715168 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.716522 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.716981 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.717074 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.719354 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:47.719360 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:47.719363 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:47.719397 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:47.722152 (+ 2755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:47.722766 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:47.722771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:47.722819 (+ 48us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:47.722960 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:47.723307 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:47.723310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:47.723312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:47.723669 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:47.723915 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.724164 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.724336 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 18:34:47.733207 14515 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:34:47.741299 14515 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:34:47.775566 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.756405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:37179 (local address 127.0.0.1:36008)
0810 18:34:47.763290 (+ 6885us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:47.763339 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:47.764411 (+ 1072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:47.766330 (+ 1919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:47.766337 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:47.766366 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:47.766732 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.766744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.768961 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.768970 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.772451 (+ 3481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.772480 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.774436 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.774443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.774648 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.774709 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 18:34:47.774860 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 18:34:47.775058 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6621,"mutex_wait_us":3,"thread_start_us":7075,"threads_started":1}
I20260810 18:34:47.775671 15036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.756781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.13.139.3:37179)
0810 18:34:47.765730 (+ 8949us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.765738 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.765768 (+ 30us) server_negotiation.cc:407] Connection header received
0810 18:34:47.765868 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.765875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.766106 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.766933 (+ 827us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:47.767205 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.768773 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.772716 (+ 3943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.774201 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.774353 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.774610 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.775104 (+ 494us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.775283 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8787,"thread_start_us":11665,"threads_started":1}
I20260810 18:34:47.776381 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.757302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47774 (local address 127.13.139.2:39995)
0810 18:34:47.765177 (+ 7875us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.765186 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.765675 (+ 489us) server_negotiation.cc:407] Connection header received
0810 18:34:47.765994 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.766002 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.766267 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.766478 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:47.767639 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.770157 (+ 2518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.773255 (+ 3098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.774645 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.774788 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.774979 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.775853 (+ 874us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.776025 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7714,"thread_start_us":7558,"threads_started":1}
I20260810 18:34:47.775699 15037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.756879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:39995 (local address 127.0.0.1:47774)
0810 18:34:47.765562 (+ 8683us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:47.765582 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:47.765786 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:47.766858 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:47.766862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:47.766898 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:47.767357 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.767372 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.770397 (+ 3025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.770405 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.773087 (+ 2682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.773100 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.774885 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.774893 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.775080 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.775115 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:34:47.775198 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 18:34:47.775329 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8546,"thread_start_us":8403,"threads_started":1}
I20260810 18:34:47.780558 15041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.768735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:45163 (local address 127.0.0.1:53404)
0810 18:34:47.772743 (+ 4008us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:47.772760 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:47.772968 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:47.773790 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:47.773795 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:47.773821 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:47.774272 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.774300 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.776326 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.776332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.777985 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.777996 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.779813 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.779820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.779995 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.780037 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 18:34:47.780137 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 18:34:47.780255 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3877,"thread_start_us":3718,"threads_started":1}
I20260810 18:34:47.780685 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.766082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53404 (local address 127.13.139.1:45163)
0810 18:34:47.772087 (+ 6005us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.772096 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.773178 (+ 1082us) server_negotiation.cc:407] Connection header received
0810 18:34:47.773284 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.773292 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.773577 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.773783 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:47.774489 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.776150 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.778151 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.779601 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.779739 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.779952 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.780200 (+ 248us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.780371 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5813,"thread_start_us":5681,"threads_started":1}
I20260810 18:34:47.780766 14945 tablet_service.cc:1467] Processing CreateTablet for tablet 4720ea61d969411d9f1a34af51032af5 (DEFAULT_TABLE table=test-table [id=f01961627ddc45fca50a7d3b8df7c920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:47.781176 14798 tablet_service.cc:1467] Processing CreateTablet for tablet 4720ea61d969411d9f1a34af51032af5 (DEFAULT_TABLE table=test-table [id=f01961627ddc45fca50a7d3b8df7c920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:47.782588 14798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4720ea61d969411d9f1a34af51032af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:47.782589 14945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4720ea61d969411d9f1a34af51032af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:47.784369 14650 tablet_service.cc:1467] Processing CreateTablet for tablet 4720ea61d969411d9f1a34af51032af5 (DEFAULT_TABLE table=test-table [id=f01961627ddc45fca50a7d3b8df7c920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:47.785892 14650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4720ea61d969411d9f1a34af51032af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:47.795167 15042 tablet_bootstrap.cc:492] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4: Bootstrap starting.
I20260810 18:34:47.797539 15043 tablet_bootstrap.cc:492] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9: Bootstrap starting.
I20260810 18:34:47.799278 15042 tablet_bootstrap.cc:654] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:47.800588 15045 tablet_bootstrap.cc:492] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7: Bootstrap starting.
I20260810 18:34:47.801229 15042 log.cc:824] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:47.802163 15043 tablet_bootstrap.cc:654] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:47.803396 15043 log.cc:824] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:47.803920 15045 tablet_bootstrap.cc:654] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:47.804579 15042 tablet_bootstrap.cc:492] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4: No bootstrap required, opened a new log
I20260810 18:34:47.804875 15042 ts_tablet_manager.cc:1397] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260810 18:34:47.805235 15045 log.cc:824] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:47.806805 15043 tablet_bootstrap.cc:492] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9: No bootstrap required, opened a new log
I20260810 18:34:47.807058 15043 ts_tablet_manager.cc:1397] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260810 18:34:47.807928 15045 tablet_bootstrap.cc:492] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7: No bootstrap required, opened a new log
I20260810 18:34:47.808171 15045 ts_tablet_manager.cc:1397] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 18:34:47.815330 15045 raft_consensus.cc:348] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.815785 15045 raft_consensus.cc:374] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:47.815919 15045 raft_consensus.cc:729] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92ea75fb44b430a8c624efa8ef56ff7, State: Initialized, Role: FOLLOWER
I20260810 18:34:47.815984 15042 raft_consensus.cc:348] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.816442 15042 raft_consensus.cc:374] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:47.816546 15042 raft_consensus.cc:729] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01027909c50f4a91a06ff54834337ef4, State: Initialized, Role: FOLLOWER
I20260810 18:34:47.816586 15045 consensus_queue.cc:260] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.817251 15042 consensus_queue.cc:260] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.818646 15045 ts_tablet_manager.cc:1428] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260810 18:34:47.818506 15043 raft_consensus.cc:348] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.819114 15043 raft_consensus.cc:374] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:47.819281 15043 raft_consensus.cc:729] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6906e155e1b48b38d7b9f40b1e47df9, State: Initialized, Role: FOLLOWER
I20260810 18:34:47.820233 15043 consensus_queue.cc:260] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.821753 15020 heartbeater.cc:503] Master 127.13.139.62:38327 was elected leader, sending a full tablet report...
I20260810 18:34:47.824203 15043 ts_tablet_manager.cc:1428] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9: Time spent starting tablet: real 0.017s user 0.015s sys 0.001s
I20260810 18:34:47.825235 15042 ts_tablet_manager.cc:1428] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4: Time spent starting tablet: real 0.020s user 0.020s sys 0.000s
I20260810 18:34:47.825704 14869 heartbeater.cc:503] Master 127.13.139.62:38327 was elected leader, sending a full tablet report...
W20260810 18:34:47.890347 14719 tablet.cc:2369] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:34:47.901717 14870 tablet.cc:2369] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:34:47.919622 15021 tablet.cc:2369] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:34:47.940738 15052 raft_consensus.cc:482] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:34:47.941031 15052 raft_consensus.cc:504] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.943074 15052 leader_election.cc:288] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01027909c50f4a91a06ff54834337ef4 (127.13.139.2:39995), a92ea75fb44b430a8c624efa8ef56ff7 (127.13.139.1:45163)
I20260810 18:34:47.949680 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.943649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:49765 (local address 127.13.139.2:39995)
0810 18:34:47.943856 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.943862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.943884 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:34:47.943964 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.943968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.944072 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.944195 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:47.944855 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.945868 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.947855 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.948891 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.948999 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.949053 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.949391 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.949479 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:34:47.949771 15022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.943392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:39995 (local address 127.13.139.3:49765)
0810 18:34:47.943619 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:47.943641 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:47.943768 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:47.944434 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:47.944437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:47.944461 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:47.944663 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.944674 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.946008 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.946013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.947709 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.947721 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.949046 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.949052 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.949235 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.949267 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 18:34:47.949363 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 18:34:47.949505 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260810 18:34:47.950667 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.944139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:54299 (local address 127.13.139.1:45163)
0810 18:34:47.944371 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:47.944377 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:47.944615 (+ 238us) server_negotiation.cc:407] Connection header received
0810 18:34:47.944729 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:47.944736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:47.944895 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:47.944967 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:47.945586 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.946543 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.948623 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.949760 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.949925 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.950001 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:47.950410 (+ 409us) server_negotiation.cc:299] Negotiation successful
0810 18:34:47.950501 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260810 18:34:47.950801 15054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:47.943812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:45163 (local address 127.13.139.3:54299)
0810 18:34:47.944508 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:47.944524 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:47.944627 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:47.945027 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:47.945032 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:47.945057 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:47.945439 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.945451 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.946711 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.946715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.948462 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:47.948476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:47.950066 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:47.950073 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:47.950224 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:47.950247 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:34:47.950322 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 18:34:47.950455 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":354,"threads_started":1}
I20260810 18:34:47.951079 14821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4720ea61d969411d9f1a34af51032af5" candidate_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01027909c50f4a91a06ff54834337ef4" is_pre_election: true
I20260810 18:34:47.951900 14821 raft_consensus.cc:2454] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6906e155e1b48b38d7b9f40b1e47df9 in term 0.
I20260810 18:34:47.952023 14670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4720ea61d969411d9f1a34af51032af5" candidate_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" is_pre_election: true
I20260810 18:34:47.952605 14670 raft_consensus.cc:2454] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6906e155e1b48b38d7b9f40b1e47df9 in term 0.
I20260810 18:34:47.952896 14892 leader_election.cc:302] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01027909c50f4a91a06ff54834337ef4, b6906e155e1b48b38d7b9f40b1e47df9; no voters:
I20260810 18:34:47.953325 15052 raft_consensus.cc:2781] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:34:47.953477 15052 raft_consensus.cc:482] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:34:47.953603 15052 raft_consensus.cc:3037] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:47.955955 15052 raft_consensus.cc:504] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.956545 15052 leader_election.cc:288] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [CANDIDATE]: Term 1 election: Requested vote from peers 01027909c50f4a91a06ff54834337ef4 (127.13.139.2:39995), a92ea75fb44b430a8c624efa8ef56ff7 (127.13.139.1:45163)
I20260810 18:34:47.956982 14821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4720ea61d969411d9f1a34af51032af5" candidate_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01027909c50f4a91a06ff54834337ef4"
I20260810 18:34:47.957080 14670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4720ea61d969411d9f1a34af51032af5" candidate_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92ea75fb44b430a8c624efa8ef56ff7"
I20260810 18:34:47.957217 14821 raft_consensus.cc:3037] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:47.957259 14670 raft_consensus.cc:3037] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:47.960561 14670 raft_consensus.cc:2454] T 4720ea61d969411d9f1a34af51032af5 P a92ea75fb44b430a8c624efa8ef56ff7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6906e155e1b48b38d7b9f40b1e47df9 in term 1.
I20260810 18:34:47.960552 14821 raft_consensus.cc:2454] T 4720ea61d969411d9f1a34af51032af5 P 01027909c50f4a91a06ff54834337ef4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6906e155e1b48b38d7b9f40b1e47df9 in term 1.
I20260810 18:34:47.960954 14892 leader_election.cc:302] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01027909c50f4a91a06ff54834337ef4, b6906e155e1b48b38d7b9f40b1e47df9; no voters:
I20260810 18:34:47.961254 15052 raft_consensus.cc:2781] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:47.961726 15052 raft_consensus.cc:686] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [term 1 LEADER]: Becoming Leader. State: Replica: b6906e155e1b48b38d7b9f40b1e47df9, State: Running, Role: LEADER
I20260810 18:34:47.962240 15052 consensus_queue.cc:237] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } }
I20260810 18:34:47.967758 14516 catalog_manager.cc:5495] T 4720ea61d969411d9f1a34af51032af5 P b6906e155e1b48b38d7b9f40b1e47df9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6906e155e1b48b38d7b9f40b1e47df9 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6906e155e1b48b38d7b9f40b1e47df9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "01027909c50f4a91a06ff54834337ef4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92ea75fb44b430a8c624efa8ef56ff7" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:34:48.025036 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:48.009041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53414 (local address 127.13.139.1:45163)
0810 18:34:48.009225 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:48.009229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:48.009785 (+ 556us) server_negotiation.cc:407] Connection header received
0810 18:34:48.009998 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:48.010007 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:48.010075 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:48.010187 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:48.011800 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.012615 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.013924 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.014372 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.014514 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:48.018908 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:48.018922 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:48.018938 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:48.018970 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:48.022072 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.022789 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.022797 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.022799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.022959 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.023337 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.023343 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.023346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.023787 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:48.024139 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:48.024415 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 18:34:48.024641 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386888, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386888, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:34:48.076300 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:48.061678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53424 (local address 127.13.139.1:45163)
0810 18:34:48.061925 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:48.061933 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:48.062215 (+ 282us) server_negotiation.cc:407] Connection header received
0810 18:34:48.062348 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:48.062352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:48.062424 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:48.062520 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:48.063974 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.064943 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.066218 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.066638 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.066738 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:48.070846 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:48.070851 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:48.070854 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:48.070889 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:48.073815 (+ 2926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.074404 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.074407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.074409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.074534 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.074921 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.074925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.074927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.075211 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:48.075552 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:48.075716 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 18:34:48.075905 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[14465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:34:48.127538 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:48.112831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53430 (local address 127.13.139.1:45163)
0810 18:34:48.113129 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:48.113136 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:48.113382 (+ 246us) server_negotiation.cc:407] Connection header received
0810 18:34:48.113610 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:48.113620 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:48.113688 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:48.113802 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:48.115278 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.116072 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.117315 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.117768 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.117910 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:48.122023 (+ 4113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:48.122029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:48.122032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:48.122067 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:48.124695 (+ 2628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.125355 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.125362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.125366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.125496 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.125873 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.125879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.125882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.126316 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:48.126579 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:48.126878 (+ 299us) server_negotiation.cc:299] Negotiation successful
0810 18:34:48.127133 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
W20260810 18:34:48.129822 14627 tablet_service.cc:2908] Rejecting scan request for tablet 4720ea61d969411d9f1a34af51032af5: Uninitialized: clean time has not yet been initialized
I20260810 18:34:48.133446 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 14581
I20260810 18:34:48.145900 15039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:48.134408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53446 (local address 127.13.139.1:45163)
0810 18:34:48.134569 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:48.134573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:48.134867 (+ 294us) server_negotiation.cc:407] Connection header received
0810 18:34:48.135041 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:48.135044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:48.135111 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:48.135190 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:48.136364 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.137033 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.138159 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.138565 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.138668 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:48.141022 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:48.141027 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:48.141030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:48.141058 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:48.143591 (+ 2533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.144261 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.144264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.144266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.144379 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.144752 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.144755 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.144757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.145054 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:48.145291 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:48.145513 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 18:34:48.145681 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:34:48.146695 14711 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:48.245441 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 14581
I20260810 18:34:48.267153 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 14724
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:34:48.283178 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:48.268000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47786 (local address 127.13.139.2:39995)
0810 18:34:48.268174 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:48.268178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:48.268228 (+ 50us) server_negotiation.cc:407] Connection header received
0810 18:34:48.268394 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:48.268398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:48.268496 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:48.268592 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:48.269745 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.270628 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.272104 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.272503 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.272600 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:48.276477 (+ 3877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:48.276509 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:48.276527 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:48.276560 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:48.280553 (+ 3993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.281210 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.281217 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.281219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.281344 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.281739 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.281742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.281744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.282197 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:48.282464 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:48.282752 (+ 288us) server_negotiation.cc:299] Negotiation successful
0810 18:34:48.282923 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:34:48.283998 14863 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:48.373680 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 14724
I20260810 18:34:48.393864 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 14874
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[14465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:34:48.409742 15072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:48.394682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36024 (local address 127.13.139.3:37179)
0810 18:34:48.395145 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:48.395150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:48.395167 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:34:48.395223 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:48.395226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:48.395284 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:48.395376 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:48.396826 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.397527 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.398993 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:48.399672 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:48.399790 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:48.403889 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:48.403904 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:48.403921 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:48.403974 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:48.406928 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.407714 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.407722 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.407724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.407876 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:48.408269 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:48.408272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:48.408274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:48.408608 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:48.408828 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:48.409128 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 18:34:48.409299 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":234,"threads_started":1}
I20260810 18:34:48.410429 15015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:48.501495 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 14874
I20260810 18:34:48.521997 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 14480
I20260810 18:34:48.523195 14547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:48.633414 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 14480
2026-08-10T18:34:48Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4425 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[15078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[15078](info): set up 2 sockets
Aug 10 18:34:48 dist-test-slave-5k54 krb5kdc[15078](info): commencing operation
krb5kdc: starting...
W20260810 18:34:49.796324 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:34:49 dist-test-slave-5k54 krb5kdc[15078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:34:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:34:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:34:49.997206 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46293
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:46293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:50.318605 15092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:50.318897 15092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:50.318985 15092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:50.326179 15092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:34:50.326280 15092 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 18:34:50.326372 15092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:50.326478 15092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:50.326571 15092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:34:50.326683 15092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:34:50.336413 15092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:46293
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:50.337703 15092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:50.339046 15092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:50.350982 15100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:50.351070 15098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:50.351094 15097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:50.351922 15092 server_base.cc:1034] running on GCE node
I20260810 18:34:50.352694 15092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:50.354001 15092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:50.355276 15092 hybrid_clock.cc:648] HybridClock initialized: now 1786386890355223 us; error 30 us; skew 500 ppm
I20260810 18:34:50.355695 15092 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:50 dist-test-slave-5k54 krb5kdc[15078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386890, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:50.358819 15092 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:34:50.360277 15092 webserver.cc:460] Webserver started at http://127.13.139.62:35421/ using document root <none> and password file <none>
I20260810 18:34:50.360941 15092 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:50.361024 15092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:50.361289 15092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:50.364157 15092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "bd4b9adebd664779a036c956c1473b04"
format_stamp: "Formatted at 2026-08-10 18:34:50 on dist-test-slave-5k54"
server_key: "98030ddb447c213da42d0b6412ffebdb"
server_key_iv: "0c3556f76d0d9eb7398177f9d65c78e0"
server_key_version: "encryptionkey@0"
I20260810 18:34:50.364866 15092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "bd4b9adebd664779a036c956c1473b04"
format_stamp: "Formatted at 2026-08-10 18:34:50 on dist-test-slave-5k54"
server_key: "98030ddb447c213da42d0b6412ffebdb"
server_key_iv: "0c3556f76d0d9eb7398177f9d65c78e0"
server_key_version: "encryptionkey@0"
I20260810 18:34:50.369741 15092 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260810 18:34:50.373085 15107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:50.374403 15092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:34:50.374634 15092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "bd4b9adebd664779a036c956c1473b04"
format_stamp: "Formatted at 2026-08-10 18:34:50 on dist-test-slave-5k54"
server_key: "98030ddb447c213da42d0b6412ffebdb"
server_key_iv: "0c3556f76d0d9eb7398177f9d65c78e0"
server_key_version: "encryptionkey@0"
I20260810 18:34:50.374821 15092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:50.394150 15092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:50.398180 15092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:50.398401 15092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:50.421021 15092 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:46293
I20260810 18:34:50.421056 15177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:46293 every 8 connection(s)
I20260810 18:34:50.422363 15092 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:34:50.425547 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 15092
I20260810 18:34:50.425796 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:34:50.426574 15178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:50.426668 13868 external_mini_cluster.cc:1428] Setting key b22927f16e560b178e07214e38d5c1f1
I20260810 18:34:50.438978 15178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04: Bootstrap starting.
Aug 10 18:34:50 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:50.442313 15178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:50.443539 15178 log.cc:824] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:50.446707 15178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04: No bootstrap required, opened a new log
I20260810 18:34:50.448979 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:50.428811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.13.139.62:46293)
0810 18:34:50.429597 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:50.429615 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:50.429665 (+ 50us) server_negotiation.cc:407] Connection header received
0810 18:34:50.431551 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:50.431574 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:50.431965 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:50.432384 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:50.433802 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:50.435032 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:50.436351 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:50.437058 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:50.437274 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:50.441715 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:50.441722 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:50.441735 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:50.441774 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:50.444936 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:50.445714 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:50.445720 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:50.445726 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:50.445933 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:50.446322 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:50.446325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:50.446327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:50.446883 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:50.447098 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:50.447596 (+ 498us) server_negotiation.cc:299] Negotiation successful
0810 18:34:50.448001 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":362,"threads_started":1}
I20260810 18:34:50.454483 15178 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4b9adebd664779a036c956c1473b04" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46293 } }
I20260810 18:34:50.454844 15178 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:50.454962 15178 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd4b9adebd664779a036c956c1473b04, State: Initialized, Role: FOLLOWER
I20260810 18:34:50.455605 15178 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4b9adebd664779a036c956c1473b04" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46293 } }
I20260810 18:34:50.455853 15178 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:34:50.456027 15178 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:34:50.456202 15178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:50.458266 15178 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4b9adebd664779a036c956c1473b04" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46293 } }
I20260810 18:34:50.458705 15178 leader_election.cc:302] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd4b9adebd664779a036c956c1473b04; no voters:
I20260810 18:34:50.459240 15178 leader_election.cc:288] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:34:50.459406 15185 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:50.460446 15185 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [term 1 LEADER]: Becoming Leader. State: Replica: bd4b9adebd664779a036c956c1473b04, State: Running, Role: LEADER
I20260810 18:34:50.461002 15185 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4b9adebd664779a036c956c1473b04" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46293 } }
I20260810 18:34:50.461360 15178 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:34:50.464152 15186 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd4b9adebd664779a036c956c1473b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4b9adebd664779a036c956c1473b04" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46293 } } }
I20260810 18:34:50.464423 15188 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd4b9adebd664779a036c956c1473b04. Latest consensus state: current_term: 1 leader_uuid: "bd4b9adebd664779a036c956c1473b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4b9adebd664779a036c956c1473b04" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46293 } } }
I20260810 18:34:50.464661 15186 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:50.464682 15188 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04 [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:50.466957 15194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:34:50.472429 15194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:34:50.483000 15194 catalog_manager.cc:1347] Generated new cluster ID: dad3ee3eb57f4400a633e28873520525
I20260810 18:34:50.483124 15194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:34:50.493171 15194 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:34:50.494560 15194 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:34:50.505729 15194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04: Generated new TSK 0
I20260810 18:34:50.506794 15194 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:34:50.559267 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46293
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:50.971284 15210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:50.971654 15210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:50.971832 15210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:50.979377 15210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:50.979538 15210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:50.979683 15210 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:34:50.979813 15210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:34:50.989558 15210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:46293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:50.990896 15210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:50.992329 15210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:51.009693 15218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:51.009650 15216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:51.010536 15215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:51.012018 15210 server_base.cc:1034] running on GCE node
I20260810 18:34:51.013046 15210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:51.014083 15210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:51.015303 15210 hybrid_clock.cc:648] HybridClock initialized: now 1786386891015230 us; error 39 us; skew 500 ppm
I20260810 18:34:51.015688 15210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:51 dist-test-slave-5k54 krb5kdc[15078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386891, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:51.024492 15210 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:34:51.026199 15210 webserver.cc:460] Webserver started at http://127.13.139.1:39847/ using document root <none> and password file <none>
I20260810 18:34:51.027141 15210 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:51.027258 15210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:51.027645 15210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:51.031304 15210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "c59258f6f2864942ae0a88d0c44d869b"
format_stamp: "Formatted at 2026-08-10 18:34:51 on dist-test-slave-5k54"
server_key: "45754d3efb6388606834da10b440b306"
server_key_iv: "1d0c73708571d5dcf4da9101e2b3338c"
server_key_version: "encryptionkey@0"
I20260810 18:34:51.032608 15210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "c59258f6f2864942ae0a88d0c44d869b"
format_stamp: "Formatted at 2026-08-10 18:34:51 on dist-test-slave-5k54"
server_key: "45754d3efb6388606834da10b440b306"
server_key_iv: "1d0c73708571d5dcf4da9101e2b3338c"
server_key_version: "encryptionkey@0"
I20260810 18:34:51.039058 15210 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260810 18:34:51.043042 15225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:51.044349 15210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:34:51.044519 15210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "c59258f6f2864942ae0a88d0c44d869b"
format_stamp: "Formatted at 2026-08-10 18:34:51 on dist-test-slave-5k54"
server_key: "45754d3efb6388606834da10b440b306"
server_key_iv: "1d0c73708571d5dcf4da9101e2b3338c"
server_key_version: "encryptionkey@0"
I20260810 18:34:51.044727 15210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:51.067485 15210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:51.071615 15210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:51.071882 15210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:51.075462 15210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:51.075555 15210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:51.075744 15210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:51.075817 15210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:34:51 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386891, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:51.101476 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.076607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:33827 (local address 127.13.139.62:46293)
0810 18:34:51.077136 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:51.077143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:51.078556 (+ 1413us) server_negotiation.cc:407] Connection header received
0810 18:34:51.081264 (+ 2708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:51.081273 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:51.081390 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:51.081536 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:51.083893 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.085241 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.087680 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.088270 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.088410 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.093125 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:51.093135 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:51.093142 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:51.093192 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:51.096841 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.097909 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.097917 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.097922 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.098093 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.098726 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.098734 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.098739 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.099196 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:51.099391 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:51.100716 (+ 1325us) server_negotiation.cc:299] Negotiation successful
0810 18:34:51.100986 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":266,"threads_started":1}
I20260810 18:34:51.103446 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.077243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46293 (local address 127.13.139.1:33827)
0810 18:34:51.078369 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:51.078417 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:51.080873 (+ 2456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:51.081867 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:51.081880 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:51.082720 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:51.083641 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.083677 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.085431 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.085440 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.087455 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.087477 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.088562 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.088576 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.088802 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.089687 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:51.089713 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:51.092820 (+ 3107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:51.097025 (+ 4205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.097033 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.097055 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.097713 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.098245 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.098250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.098253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.098569 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.099520 (+ 951us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:51.099533 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:51.100171 (+ 638us) client_negotiation.cc:769] Sending connection context
0810 18:34:51.100564 (+ 393us) client_negotiation.cc:240] Negotiation successful
0810 18:34:51.101322 (+ 758us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"thread_start_us":611,"threads_started":1}
I20260810 18:34:51.120520 15210 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:40715
I20260810 18:34:51.120582 15359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:40715 every 8 connection(s)
I20260810 18:34:51.122025 15210 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:34:51.124495 15360 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46293
I20260810 18:34:51.124734 15360 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:51.125550 15360 heartbeater.cc:511] Master 127.13.139.62:46293 requested a full tablet report, sending...
I20260810 18:34:51.127750 15128 ts_manager.cc:194] Registered new tserver with Master: c59258f6f2864942ae0a88d0c44d869b (127.13.139.1:40715)
I20260810 18:34:51.129442 15128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:33827
I20260810 18:34:51.130240 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 15210
I20260810 18:34:51.130501 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:34:51.131311 13868 external_mini_cluster.cc:1428] Setting key 6f5f6714d149a24a421ef03a9e6a992c
I20260810 18:34:51.132624 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.118464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:37813 (local address 127.13.139.62:46293)
0810 18:34:51.118697 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:51.118706 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:51.119372 (+ 666us) server_negotiation.cc:407] Connection header received
0810 18:34:51.119701 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:51.119708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:51.119822 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:51.119922 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:51.121431 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.122171 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.124184 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.124927 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.125068 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.126946 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:51.126956 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:51.126959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:51.126991 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:51.129774 (+ 2783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.130448 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.130455 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.130461 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.130652 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.131031 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.131037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.131042 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.131460 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:51.131638 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:51.132014 (+ 376us) server_negotiation.cc:299] Negotiation successful
0810 18:34:51.132241 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:34:51.132728 15357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.118464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46293 (local address 127.13.139.1:37813)
0810 18:34:51.119241 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:51.119268 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:51.119499 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:51.120145 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:51.120153 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:51.120891 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:51.121261 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.121277 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.122313 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.122319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.124088 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.124100 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.125104 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.125109 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.125248 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.125907 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:51.125924 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:51.126751 (+ 827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:51.129904 (+ 3153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.129909 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.129914 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.130289 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.130779 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.130784 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.130788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.130924 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.131583 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:51.131586 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:51.131734 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 18:34:51.131874 (+ 140us) client_negotiation.cc:240] Negotiation successful
0810 18:34:51.132211 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":388,"threads_started":1}
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:34:51.175318 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46293
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:51.500353 15365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:51.500620 15365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:51.500777 15365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:51.508225 15365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:51.508355 15365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:51.508502 15365 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:34:51.508622 15365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:34:51.518285 15365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:46293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:51.519598 15365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:51.520951 15365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:51.534260 15372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:51.534302 15373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:51.534281 15375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:51.535104 15365 server_base.cc:1034] running on GCE node
I20260810 18:34:51.535828 15365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:51.536724 15365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:51.537957 15365 hybrid_clock.cc:648] HybridClock initialized: now 1786386891537870 us; error 64 us; skew 500 ppm
I20260810 18:34:51.538252 15365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:51 dist-test-slave-5k54 krb5kdc[15078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386891, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:51.541378 15365 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:34:51.542781 15365 webserver.cc:460] Webserver started at http://127.13.139.2:45603/ using document root <none> and password file <none>
I20260810 18:34:51.543540 15365 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:51.543666 15365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:51.543980 15365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:51.546876 15365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "60fd406928224280b6e745cc133b0a3e"
format_stamp: "Formatted at 2026-08-10 18:34:51 on dist-test-slave-5k54"
server_key: "92272147884c5e7282d212405f852b07"
server_key_iv: "8db7932cab96bec40711aa6f925f6a8b"
server_key_version: "encryptionkey@0"
I20260810 18:34:51.547803 15365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "60fd406928224280b6e745cc133b0a3e"
format_stamp: "Formatted at 2026-08-10 18:34:51 on dist-test-slave-5k54"
server_key: "92272147884c5e7282d212405f852b07"
server_key_iv: "8db7932cab96bec40711aa6f925f6a8b"
server_key_version: "encryptionkey@0"
I20260810 18:34:51.552855 15365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 18:34:51.556206 15382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:51.557443 15365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:34:51.557615 15365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "60fd406928224280b6e745cc133b0a3e"
format_stamp: "Formatted at 2026-08-10 18:34:51 on dist-test-slave-5k54"
server_key: "92272147884c5e7282d212405f852b07"
server_key_iv: "8db7932cab96bec40711aa6f925f6a8b"
server_key_version: "encryptionkey@0"
I20260810 18:34:51.557821 15365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:51.578639 15365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:51.582490 15365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:51.582772 15365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:51.585348 15365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:51.585462 15365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:51.585669 15365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:51.585786 15365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:34:51 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386891, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:51.607657 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.585717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:40519 (local address 127.13.139.62:46293)
0810 18:34:51.585923 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:51.585932 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:51.587416 (+ 1484us) server_negotiation.cc:407] Connection header received
0810 18:34:51.589411 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:51.589420 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:51.589534 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:51.589684 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:51.591797 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.593136 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.595752 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.596206 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.596343 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.601356 (+ 5013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:51.601361 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:51.601364 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:51.601398 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:51.604595 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.605292 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.605298 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.605306 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.605428 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.605911 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.605920 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.605922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.606185 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:51.606352 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:51.607067 (+ 715us) server_negotiation.cc:299] Negotiation successful
0810 18:34:51.607287 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:34:51.609256 15391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.586336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46293 (local address 127.13.139.2:40519)
0810 18:34:51.587223 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:51.587278 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:51.589133 (+ 1855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:51.589963 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:51.589977 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:51.590745 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:51.591578 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.591618 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.593329 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.593336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.595591 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.595603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.596457 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.596465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.596679 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.597423 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:51.597469 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:51.601123 (+ 3654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:51.604726 (+ 3603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.604734 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.604749 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.605161 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.605535 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.605541 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.605544 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.605733 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.606315 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:51.606324 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:51.606673 (+ 349us) client_negotiation.cc:769] Sending connection context
0810 18:34:51.606930 (+ 257us) client_negotiation.cc:240] Negotiation successful
0810 18:34:51.607473 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":381,"threads_started":1}
I20260810 18:34:51.633462 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.615741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:38201 (local address 127.13.139.62:46293)
0810 18:34:51.615918 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:51.615922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:51.616601 (+ 679us) server_negotiation.cc:407] Connection header received
0810 18:34:51.616800 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:51.616805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:51.616880 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:51.616992 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:51.618810 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.620121 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.622159 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.622978 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.623138 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.625753 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:51.625757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:51.625761 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:51.625791 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:51.629461 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.630648 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.630656 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.630662 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.630846 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:51.631593 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:51.631602 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:51.631608 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:51.632205 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:51.632406 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:51.632872 (+ 466us) server_negotiation.cc:299] Negotiation successful
0810 18:34:51.633101 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 18:34:51.633589 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:51.615892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46293 (local address 127.13.139.2:38201)
0810 18:34:51.616497 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:51.616514 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:51.616670 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:51.617061 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:51.617070 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:51.618007 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:51.618578 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.618600 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.620288 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.620294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.621989 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:51.622011 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:51.623207 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:51.623217 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:51.623462 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:51.624322 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:51.624340 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:51.625522 (+ 1182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:51.629651 (+ 4129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.629660 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.629664 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.630505 (+ 841us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.630996 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:51.631000 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:51.631002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:51.631133 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:51.632396 (+ 1263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:51.632400 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:51.632575 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 18:34:51.632756 (+ 181us) client_negotiation.cc:240] Negotiation successful
0810 18:34:51.633112 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":350,"threads_started":1}
I20260810 18:34:51.638996 15365 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:38825
I20260810 18:34:51.639021 15512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:38825 every 8 connection(s)
I20260810 18:34:51.640244 15365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:34:51.642163 15513 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46293
I20260810 18:34:51.642390 15513 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:51.642979 15513 heartbeater.cc:511] Master 127.13.139.62:46293 requested a full tablet report, sending...
I20260810 18:34:51.644325 15128 ts_manager.cc:194] Registered new tserver with Master: 60fd406928224280b6e745cc133b0a3e (127.13.139.2:38825)
I20260810 18:34:51.644330 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 15365
I20260810 18:34:51.644594 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:34:51.645052 13868 external_mini_cluster.cc:1428] Setting key b80d0b6da2667458a8f8386a75af012d
I20260810 18:34:51.645274 15128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:40519
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:34:51.690784 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46293
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:52.021229 15518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:52.021492 15518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:52.021647 15518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:52.028911 15518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:52.029033 15518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:52.029187 15518 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:34:52.029312 15518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:34:52.039036 15518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:46293
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:52.040369 15518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:52.041739 15518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:52.055236 15526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:52.055238 15524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:52.055534 15523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:52.056082 15518 server_base.cc:1034] running on GCE node
I20260810 18:34:52.056695 15518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:52.057614 15518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:52.058874 15518 hybrid_clock.cc:648] HybridClock initialized: now 1786386892058795 us; error 44 us; skew 500 ppm
I20260810 18:34:52.059222 15518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:52 dist-test-slave-5k54 krb5kdc[15078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386892, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:52.062906 15518 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:34:52.064419 15518 webserver.cc:460] Webserver started at http://127.13.139.3:35121/ using document root <none> and password file <none>
I20260810 18:34:52.065146 15518 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:52.065274 15518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:52.065598 15518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:52.068722 15518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "f3058ff37a344cf6a3e86107d6a70aa2"
format_stamp: "Formatted at 2026-08-10 18:34:52 on dist-test-slave-5k54"
server_key: "eaca03c9407b1077107a9234509cfe61"
server_key_iv: "452c06968067a907d47c2c8d36b013cf"
server_key_version: "encryptionkey@0"
I20260810 18:34:52.069700 15518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "f3058ff37a344cf6a3e86107d6a70aa2"
format_stamp: "Formatted at 2026-08-10 18:34:52 on dist-test-slave-5k54"
server_key: "eaca03c9407b1077107a9234509cfe61"
server_key_iv: "452c06968067a907d47c2c8d36b013cf"
server_key_version: "encryptionkey@0"
I20260810 18:34:52.074960 15518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 18:34:52.078508 15533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:52.080080 15518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:34:52.080205 15518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "f3058ff37a344cf6a3e86107d6a70aa2"
format_stamp: "Formatted at 2026-08-10 18:34:52 on dist-test-slave-5k54"
server_key: "eaca03c9407b1077107a9234509cfe61"
server_key_iv: "452c06968067a907d47c2c8d36b013cf"
server_key_version: "encryptionkey@0"
I20260810 18:34:52.080384 15518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:52.095306 15518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:52.099699 15518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:52.099931 15518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:52.102486 15518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:52.102620 15518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:52.102778 15518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:52.102852 15518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:34:52 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386892, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:52.126488 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.103374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:41649 (local address 127.13.139.62:46293)
0810 18:34:52.103599 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.103604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.105148 (+ 1544us) server_negotiation.cc:407] Connection header received
0810 18:34:52.107693 (+ 2545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.107702 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.107806 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.107890 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:52.110968 (+ 3078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.112281 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.114894 (+ 2613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.115484 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.115627 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.120199 (+ 4572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:52.120204 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:52.120208 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:52.120251 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:52.122968 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:52.123797 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:52.123805 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:52.123812 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:52.124006 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:52.124688 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:52.124693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:52.124697 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:52.125009 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:52.125181 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.125895 (+ 714us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.126132 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260810 18:34:52.127784 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.104087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46293 (local address 127.13.139.3:41649)
0810 18:34:52.104974 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.105023 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.107188 (+ 2165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.108511 (+ 1323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.108533 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.109319 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:52.110707 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.110728 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.112456 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.112462 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.114748 (+ 2286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.114761 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.115867 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.115871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.116051 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.116788 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:52.116831 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:52.119971 (+ 3140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:52.123127 (+ 3156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:52.123136 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:52.123152 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:52.123673 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:52.124171 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:52.124178 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:52.124187 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:52.124555 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:52.125145 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:52.125153 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:52.125497 (+ 344us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.125761 (+ 264us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.126306 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":385,"threads_started":1}
I20260810 18:34:52.134811 15360 heartbeater.cc:503] Master 127.13.139.62:46293 was elected leader, sending a full tablet report...
I20260810 18:34:52.150060 15590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.135013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46293 (local address 127.13.139.3:34603)
0810 18:34:52.135707 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.135728 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.135861 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.136489 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.136494 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.137046 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:52.137407 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.137417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.138392 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.138397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.139460 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.139480 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.140403 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.140415 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.140756 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.141601 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:52.141636 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:52.142767 (+ 1131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:52.146770 (+ 4003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:52.146776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:52.146782 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:52.147467 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:52.147874 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:52.147879 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:52.147882 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:52.148031 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:52.148687 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:52.148694 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:52.148930 (+ 236us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.149116 (+ 186us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.149479 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":937,"threads_started":1}
I20260810 18:34:52.150936 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.135566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:34603 (local address 127.13.139.62:46293)
0810 18:34:52.135792 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.135798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.135816 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:34:52.136047 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.136052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.136164 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.136247 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:52.137552 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.138242 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.139621 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.140082 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.140228 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.142967 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:52.142972 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:52.142975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:52.143005 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:52.146595 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:52.147598 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:52.147605 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:52.147608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:52.147758 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:52.148153 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:52.148158 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:52.148161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:52.148522 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:52.150342 (+ 1820us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.150486 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.150705 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260810 18:34:52.167326 15518 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:44029
I20260810 18:34:52.167361 15666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:44029 every 8 connection(s)
I20260810 18:34:52.168726 15518 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:34:52.170871 15667 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46293
I20260810 18:34:52.171049 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 15518
I20260810 18:34:52.171121 15667 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:52.171259 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:34:52.171743 13868 external_mini_cluster.cc:1428] Setting key c0e029e36a513a5d3a50b81e7ab6d44b
I20260810 18:34:52.171974 15667 heartbeater.cc:511] Master 127.13.139.62:46293 requested a full tablet report, sending...
I20260810 18:34:52.173687 15128 ts_manager.cc:194] Registered new tserver with Master: f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3:44029)
I20260810 18:34:52.174644 15128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:41649
I20260810 18:34:52.175083 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 18:34:52 dist-test-slave-5k54 krb5kdc[15078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 18:34:52 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:52.226466 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.212421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.13.139.62:46293)
0810 18:34:52.212653 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.212661 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.212869 (+ 208us) server_negotiation.cc:407] Connection header received
0810 18:34:52.213105 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.213110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.213175 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.213280 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:52.214653 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.215411 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.216726 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.217131 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.217265 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.221045 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:52.221051 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:52.221054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:52.221087 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:52.223411 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:52.224255 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:52.224262 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:52.224266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:52.224437 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:52.224928 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:52.224932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:52.224935 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:52.225219 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:52.225490 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.225812 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.226089 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 18:34:52.230648 15128 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:34:52.237422 15128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:34:52.274981 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.249829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60778 (local address 127.13.139.2:38825)
0810 18:34:52.265795 (+ 15966us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.265802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.265827 (+ 25us) server_negotiation.cc:407] Connection header received
0810 18:34:52.265906 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.265911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.266125 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.266342 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:52.267267 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.269047 (+ 1780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.272226 (+ 3179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.273652 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.273801 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.274029 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.274450 (+ 421us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.274655 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15803,"thread_start_us":15674,"threads_started":1}
I20260810 18:34:52.275097 15683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.249615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:38825 (local address 127.0.0.1:60778)
0810 18:34:52.262861 (+ 13246us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.262919 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.263164 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.266347 (+ 3183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.266354 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.266384 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:52.266913 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.266938 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.269207 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.269216 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.271999 (+ 2783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.272016 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.273867 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.273873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.274125 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.274191 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.274358 (+ 167us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.274635 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12376,"mutex_wait_us":96,"thread_start_us":15545,"threads_started":1}
I20260810 18:34:52.276894 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.250435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34974 (local address 127.13.139.1:40715)
0810 18:34:52.268837 (+ 18402us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.268845 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.268872 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:34:52.268963 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.268973 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.269254 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.269440 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:52.270269 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.271652 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.274142 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.275823 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.275979 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.276195 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.276450 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.276599 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18248,"thread_start_us":19157,"threads_started":1}
I20260810 18:34:52.279243 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.264012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50706 (local address 127.13.139.3:44029)
0810 18:34:52.267716 (+ 3704us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.267725 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.270342 (+ 2617us) server_negotiation.cc:407] Connection header received
0810 18:34:52.270664 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.270671 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.270891 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.271081 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:52.271828 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.273895 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.276641 (+ 2746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.278020 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.278094 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.278240 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.278726 (+ 486us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.278898 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3534,"thread_start_us":3294,"threads_started":1}
I20260810 18:34:52.279253 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.263920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:44029 (local address 127.0.0.1:50706)
0810 18:34:52.270239 (+ 6319us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.270255 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.270447 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.271101 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.271106 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.271131 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:52.271625 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.271638 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.274068 (+ 2430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.274075 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.276457 (+ 2382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.276471 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.278377 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.278381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.278551 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.278571 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.278660 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.278787 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6178,"mutex_wait_us":39,"thread_start_us":6004,"threads_started":1}
I20260810 18:34:52.279477 15437 tablet_service.cc:1467] Processing CreateTablet for tablet a23eb00ed59d4c3fb459ccfde50a6e93 (DEFAULT_TABLE table=test-table [id=196f2b5637ea49c19dc2f987d5eb857e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:52.281040 15437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a23eb00ed59d4c3fb459ccfde50a6e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:52.282871 15591 tablet_service.cc:1467] Processing CreateTablet for tablet a23eb00ed59d4c3fb459ccfde50a6e93 (DEFAULT_TABLE table=test-table [id=196f2b5637ea49c19dc2f987d5eb857e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:52.284365 15591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a23eb00ed59d4c3fb459ccfde50a6e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:52.287828 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.249837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40715 (local address 127.0.0.1:34974)
0810 18:34:52.264890 (+ 15053us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.264913 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.265070 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.269434 (+ 4364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.269438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.269463 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:52.270029 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.270045 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.271819 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.271823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.273943 (+ 2120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.273958 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.276046 (+ 2088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.276053 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.276241 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.276273 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.276388 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.276527 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14841,"mutex_wait_us":1,"thread_start_us":11984,"threads_started":1}
I20260810 18:34:52.290724 15283 tablet_service.cc:1467] Processing CreateTablet for tablet a23eb00ed59d4c3fb459ccfde50a6e93 (DEFAULT_TABLE table=test-table [id=196f2b5637ea49c19dc2f987d5eb857e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:52.292111 15283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a23eb00ed59d4c3fb459ccfde50a6e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:52.296628 15688 tablet_bootstrap.cc:492] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Bootstrap starting.
I20260810 18:34:52.300182 15688 tablet_bootstrap.cc:654] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:52.300920 15689 tablet_bootstrap.cc:492] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Bootstrap starting.
I20260810 18:34:52.301597 15688 log.cc:824] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:52.304448 15689 tablet_bootstrap.cc:654] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:52.304876 15688 tablet_bootstrap.cc:492] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: No bootstrap required, opened a new log
I20260810 18:34:52.305172 15688 ts_tablet_manager.cc:1397] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260810 18:34:52.305737 15689 log.cc:824] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:52.305980 15691 tablet_bootstrap.cc:492] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Bootstrap starting.
I20260810 18:34:52.309259 15691 tablet_bootstrap.cc:654] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:52.309684 15689 tablet_bootstrap.cc:492] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: No bootstrap required, opened a new log
I20260810 18:34:52.309958 15689 ts_tablet_manager.cc:1397] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:34:52.310370 15691 log.cc:824] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:52.312997 15691 tablet_bootstrap.cc:492] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: No bootstrap required, opened a new log
I20260810 18:34:52.313239 15691 ts_tablet_manager.cc:1397] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 18:34:52.316354 15688 raft_consensus.cc:348] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.316792 15688 raft_consensus.cc:374] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:52.316895 15688 raft_consensus.cc:729] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fd406928224280b6e745cc133b0a3e, State: Initialized, Role: FOLLOWER
I20260810 18:34:52.317518 15688 consensus_queue.cc:260] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.320590 15691 raft_consensus.cc:348] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.320912 15691 raft_consensus.cc:374] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:52.321033 15691 raft_consensus.cc:729] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59258f6f2864942ae0a88d0c44d869b, State: Initialized, Role: FOLLOWER
I20260810 18:34:52.321645 15513 heartbeater.cc:503] Master 127.13.139.62:46293 was elected leader, sending a full tablet report...
I20260810 18:34:52.321795 15689 raft_consensus.cc:348] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.322235 15689 raft_consensus.cc:374] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:52.322373 15688 ts_tablet_manager.cc:1428] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Time spent starting tablet: real 0.017s user 0.015s sys 0.002s
I20260810 18:34:52.322360 15689 raft_consensus.cc:729] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3058ff37a344cf6a3e86107d6a70aa2, State: Initialized, Role: FOLLOWER
I20260810 18:34:52.322611 15691 consensus_queue.cc:260] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.322934 15689 consensus_queue.cc:260] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.324458 15691 ts_tablet_manager.cc:1428] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260810 18:34:52.325464 15667 heartbeater.cc:503] Master 127.13.139.62:46293 was elected leader, sending a full tablet report...
I20260810 18:34:52.326187 15689 ts_tablet_manager.cc:1428] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Time spent starting tablet: real 0.016s user 0.008s sys 0.010s
W20260810 18:34:52.374821 15361 tablet.cc:2369] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:34:52.392169 15514 tablet.cc:2369] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:34:52.420516 15668 tablet.cc:2369] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:34:52.486708 15697 raft_consensus.cc:482] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:34:52.487056 15697 raft_consensus.cc:504] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.488987 15697 leader_election.cc:288] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fd406928224280b6e745cc133b0a3e (127.13.139.2:38825), c59258f6f2864942ae0a88d0c44d869b (127.13.139.1:40715)
I20260810 18:34:52.494829 15542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.489438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40715 (local address 127.13.139.3:50387)
0810 18:34:52.489661 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.489683 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.489815 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.490212 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.490217 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.490246 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:52.490609 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.490621 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.491654 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.491659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.492968 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.492980 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.494111 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.494117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.494305 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.494328 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.494437 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.494570 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 18:34:52.494829 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.489720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:50387 (local address 127.13.139.1:40715)
0810 18:34:52.489899 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.489903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.489934 (+ 31us) server_negotiation.cc:407] Connection header received
0810 18:34:52.489999 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.490003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.490068 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.490180 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:52.490768 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.491507 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.493190 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.493958 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.494122 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.494196 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.494465 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.494590 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 18:34:52.496122 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.489440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:38825 (local address 127.13.139.3:54605)
0810 18:34:52.490737 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.490751 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.490892 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.491216 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.491221 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.491245 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:52.491637 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.491647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.492780 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.492788 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.494166 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.494178 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.495579 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.495583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.495699 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.495719 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.495790 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.495870 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"mutex_wait_us":455,"thread_start_us":425,"threads_started":1}
I20260810 18:34:52.495965 15304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a23eb00ed59d4c3fb459ccfde50a6e93" candidate_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59258f6f2864942ae0a88d0c44d869b" is_pre_election: true
I20260810 18:34:52.496263 15682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.489501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:54605 (local address 127.13.139.2:38825)
0810 18:34:52.489706 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.489712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.490853 (+ 1141us) server_negotiation.cc:407] Connection header received
0810 18:34:52.491047 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.491051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.491109 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.491204 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:52.491803 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.492503 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.494330 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.495342 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.495581 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.495657 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.495839 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.495990 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 18:34:52.496560 15304 raft_consensus.cc:2454] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3058ff37a344cf6a3e86107d6a70aa2 in term 0.
I20260810 18:34:52.497248 15536 leader_election.cc:302] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59258f6f2864942ae0a88d0c44d869b, f3058ff37a344cf6a3e86107d6a70aa2; no voters:
I20260810 18:34:52.497287 15464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a23eb00ed59d4c3fb459ccfde50a6e93" candidate_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fd406928224280b6e745cc133b0a3e" is_pre_election: true
I20260810 18:34:52.497609 15697 raft_consensus.cc:2781] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:34:52.497745 15697 raft_consensus.cc:482] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:34:52.497852 15697 raft_consensus.cc:3037] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:52.497802 15464 raft_consensus.cc:2454] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3058ff37a344cf6a3e86107d6a70aa2 in term 0.
I20260810 18:34:52.500213 15697 raft_consensus.cc:504] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.500794 15697 leader_election.cc:288] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [CANDIDATE]: Term 1 election: Requested vote from peers 60fd406928224280b6e745cc133b0a3e (127.13.139.2:38825), c59258f6f2864942ae0a88d0c44d869b (127.13.139.1:40715)
I20260810 18:34:52.501238 15464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a23eb00ed59d4c3fb459ccfde50a6e93" candidate_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fd406928224280b6e745cc133b0a3e"
I20260810 18:34:52.501279 15304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a23eb00ed59d4c3fb459ccfde50a6e93" candidate_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59258f6f2864942ae0a88d0c44d869b"
I20260810 18:34:52.501426 15464 raft_consensus.cc:3037] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:52.501556 15304 raft_consensus.cc:3037] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:52.504134 15464 raft_consensus.cc:2454] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3058ff37a344cf6a3e86107d6a70aa2 in term 1.
I20260810 18:34:52.504431 15304 raft_consensus.cc:2454] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3058ff37a344cf6a3e86107d6a70aa2 in term 1.
I20260810 18:34:52.504513 15534 leader_election.cc:302] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60fd406928224280b6e745cc133b0a3e, f3058ff37a344cf6a3e86107d6a70aa2; no voters:
I20260810 18:34:52.504861 15697 raft_consensus.cc:2781] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:52.505331 15697 raft_consensus.cc:686] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 LEADER]: Becoming Leader. State: Replica: f3058ff37a344cf6a3e86107d6a70aa2, State: Running, Role: LEADER
I20260810 18:34:52.505858 15697 consensus_queue.cc:237] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.510779 15124 catalog_manager.cc:5495] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } health_report { overall_health: HEALTHY } } }
I20260810 18:34:52.586400 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.579957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50722 (local address 127.13.139.3:44029)
0810 18:34:52.580125 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.580129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.580473 (+ 344us) server_negotiation.cc:407] Connection header received
0810 18:34:52.580872 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.580877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.580974 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.581132 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:52.581571 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.582334 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.583870 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.584383 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.584533 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.585093 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:52.585698 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:52.585875 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.586019 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.586113 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 18:34:52.595731 15464 raft_consensus.cc:1261] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Refusing update from remote peer f3058ff37a344cf6a3e86107d6a70aa2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:52.596779 15304 raft_consensus.cc:1261] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Refusing update from remote peer f3058ff37a344cf6a3e86107d6a70aa2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:52.596972 15699 consensus_queue.cc:1035] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:52.597651 15697 consensus_queue.cc:1035] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:52.608448 15702 mvcc.cc:205] Tried to move back new op lower bound from 7317040712059682816 to 7317040711709126656. Current Snapshot: MvccSnapshot[applied={T|T < 7317040712059682816}]
I20260810 18:34:52.614432 15703 mvcc.cc:205] Tried to move back new op lower bound from 7317040712059682816 to 7317040711709126656. Current Snapshot: MvccSnapshot[applied={T|T < 7317040712059682816}]
I20260810 18:34:52.633311 15128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:34:52.633769 15128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:34:52.638541 15128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04: Sending DeleteTablet for 3 replicas of tablet a23eb00ed59d4c3fb459ccfde50a6e93
I20260810 18:34:52.639990 15437 tablet_service.cc:1514] Processing DeleteTablet for tablet a23eb00ed59d4c3fb459ccfde50a6e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:52 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:60778
I20260810 18:34:52.640214 15591 tablet_service.cc:1514] Processing DeleteTablet for tablet a23eb00ed59d4c3fb459ccfde50a6e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:52 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:50706
I20260810 18:34:52.642571 15714 tablet_replica.cc:330] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: stopping tablet replica
I20260810 18:34:52.642720 15283 tablet_service.cc:1514] Processing DeleteTablet for tablet a23eb00ed59d4c3fb459ccfde50a6e93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:52 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:34974
I20260810 18:34:52.643376 15714 raft_consensus.cc:2229] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:34:52.644541 15714 raft_consensus.cc:2258] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:52.645563 15713 tablet_replica.cc:330] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: stopping tablet replica
I20260810 18:34:52.646009 15713 raft_consensus.cc:2229] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:34:52.646552 15713 raft_consensus.cc:2258] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:52.646550 15128 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:34:52.647259 15128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:34:52.649387 15713 ts_tablet_manager.cc:1905] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:52.656095 15437 tablet_service.cc:1467] Processing CreateTablet for tablet ae9effcdb4564a139019b75b94349dad (DEFAULT_TABLE table=test-table [id=a2a8cc6688eb4375b162451bc0f9b699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:52.656585 15437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae9effcdb4564a139019b75b94349dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:52.658468 15714 ts_tablet_manager.cc:1905] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:52.659416 15713 ts_tablet_manager.cc:1918] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:34:52.659730 15713 log.cc:1196] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/a23eb00ed59d4c3fb459ccfde50a6e93
I20260810 18:34:52.660427 15713 ts_tablet_manager.cc:1939] T a23eb00ed59d4c3fb459ccfde50a6e93 P 60fd406928224280b6e745cc133b0a3e: Deleting consensus metadata
I20260810 18:34:52.660485 15282 tablet_service.cc:1467] Processing CreateTablet for tablet ae9effcdb4564a139019b75b94349dad (DEFAULT_TABLE table=test-table [id=a2a8cc6688eb4375b162451bc0f9b699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:52.661114 15282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae9effcdb4564a139019b75b94349dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:52.663553 15108 catalog_manager.cc:4841] TS 60fd406928224280b6e745cc133b0a3e (127.13.139.2:38825): tablet a23eb00ed59d4c3fb459ccfde50a6e93 (table test-table [id=196f2b5637ea49c19dc2f987d5eb857e]) successfully deleted
I20260810 18:34:52.664321 15591 tablet_service.cc:1467] Processing CreateTablet for tablet ae9effcdb4564a139019b75b94349dad (DEFAULT_TABLE table=test-table [id=a2a8cc6688eb4375b162451bc0f9b699]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:52.664884 15591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae9effcdb4564a139019b75b94349dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:52.666280 15688 tablet_bootstrap.cc:492] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: Bootstrap starting.
I20260810 18:34:52.668030 15688 tablet_bootstrap.cc:654] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:52.671725 15689 tablet_bootstrap.cc:492] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: Bootstrap starting.
I20260810 18:34:52.671751 15691 tablet_bootstrap.cc:492] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: Bootstrap starting.
I20260810 18:34:52.673307 15689 tablet_bootstrap.cc:654] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:52.673832 15691 tablet_bootstrap.cc:654] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:52.680029 15715 tablet_replica.cc:330] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: stopping tablet replica
I20260810 18:34:52.680529 15715 raft_consensus.cc:2229] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:34:52.680671 15688 tablet_bootstrap.cc:492] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: No bootstrap required, opened a new log
I20260810 18:34:52.680936 15688 ts_tablet_manager.cc:1397] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260810 18:34:52.681097 15715 raft_consensus.cc:2258] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:52.681872 15688 raft_consensus.cc:348] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.682188 15688 raft_consensus.cc:374] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:52.682288 15688 raft_consensus.cc:729] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fd406928224280b6e745cc133b0a3e, State: Initialized, Role: FOLLOWER
I20260810 18:34:52.682528 15714 ts_tablet_manager.cc:1918] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:34:52.682632 15688 consensus_queue.cc:260] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.683627 15714 log.cc:1196] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/a23eb00ed59d4c3fb459ccfde50a6e93
I20260810 18:34:52.684988 15714 ts_tablet_manager.cc:1939] T a23eb00ed59d4c3fb459ccfde50a6e93 P f3058ff37a344cf6a3e86107d6a70aa2: Deleting consensus metadata
I20260810 18:34:52.686128 15688 ts_tablet_manager.cc:1428] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260810 18:34:52.688529 15715 ts_tablet_manager.cc:1905] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:52.690840 15111 catalog_manager.cc:4841] TS f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3:44029): tablet a23eb00ed59d4c3fb459ccfde50a6e93 (table test-table [id=196f2b5637ea49c19dc2f987d5eb857e]) successfully deleted
I20260810 18:34:52.694432 15689 tablet_bootstrap.cc:492] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: No bootstrap required, opened a new log
I20260810 18:34:52.694432 15691 tablet_bootstrap.cc:492] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: No bootstrap required, opened a new log
I20260810 18:34:52.694589 15691 ts_tablet_manager.cc:1397] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.008s
I20260810 18:34:52.694597 15689 ts_tablet_manager.cc:1397] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.012s
I20260810 18:34:52.695480 15689 raft_consensus.cc:348] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.695465 15691 raft_consensus.cc:348] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.695706 15691 raft_consensus.cc:374] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:52.695706 15689 raft_consensus.cc:374] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:52.695832 15691 raft_consensus.cc:729] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59258f6f2864942ae0a88d0c44d869b, State: Initialized, Role: FOLLOWER
I20260810 18:34:52.695873 15689 raft_consensus.cc:729] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3058ff37a344cf6a3e86107d6a70aa2, State: Initialized, Role: FOLLOWER
I20260810 18:34:52.696159 15689 consensus_queue.cc:260] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.696836 15689 ts_tablet_manager.cc:1428] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 18:34:52.697175 15691 consensus_queue.cc:260] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.697767 15691 ts_tablet_manager.cc:1428] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 18:34:52.700054 15715 ts_tablet_manager.cc:1918] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:34:52.700235 15715 log.cc:1196] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/a23eb00ed59d4c3fb459ccfde50a6e93
I20260810 18:34:52.700834 15715 ts_tablet_manager.cc:1939] T a23eb00ed59d4c3fb459ccfde50a6e93 P c59258f6f2864942ae0a88d0c44d869b: Deleting consensus metadata
I20260810 18:34:52.702800 15111 catalog_manager.cc:4841] TS c59258f6f2864942ae0a88d0c44d869b (127.13.139.1:40715): tablet a23eb00ed59d4c3fb459ccfde50a6e93 (table test-table [id=196f2b5637ea49c19dc2f987d5eb857e]) successfully deleted
I20260810 18:34:52.960402 15694 raft_consensus.cc:482] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:34:52.960708 15694 raft_consensus.cc:504] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.962951 15694 leader_election.cc:288] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c59258f6f2864942ae0a88d0c44d869b (127.13.139.1:40715), f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3:44029)
I20260810 18:34:52.971005 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.963239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:51841 (local address 127.13.139.1:40715)
0810 18:34:52.963495 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.963503 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.963954 (+ 451us) server_negotiation.cc:407] Connection header received
0810 18:34:52.964308 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.964317 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.964428 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.964509 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:52.965567 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.966754 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.968633 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.969960 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.970170 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.970255 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.970562 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.970709 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:34:52.971016 15719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.963210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40715 (local address 127.13.139.2:51841)
0810 18:34:52.963850 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.963872 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.964084 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.964768 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.964788 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.964826 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:52.965337 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.965354 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.966895 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.966901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.968475 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.968486 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.970189 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.970198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.970374 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.970416 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.970524 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.970667 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":341,"threads_started":1}
I20260810 18:34:52.972045 15303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae9effcdb4564a139019b75b94349dad" candidate_uuid: "60fd406928224280b6e745cc133b0a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59258f6f2864942ae0a88d0c44d869b" is_pre_election: true
I20260810 18:34:52.972396 15303 raft_consensus.cc:2454] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fd406928224280b6e745cc133b0a3e in term 0.
I20260810 18:34:52.972728 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.963987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:44029 (local address 127.13.139.2:41049)
0810 18:34:52.965981 (+ 1994us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:52.965996 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:52.966138 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:52.966445 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:52.966450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:52.966475 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:52.966778 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.966786 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.968473 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.968478 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.970002 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:52.970024 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.971931 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.971937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:52.972144 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.972186 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 18:34:52.972288 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 18:34:52.972412 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1893,"thread_start_us":1715,"threads_started":1}
I20260810 18:34:52.973145 15385 leader_election.cc:302] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60fd406928224280b6e745cc133b0a3e, c59258f6f2864942ae0a88d0c44d869b; no voters:
I20260810 18:34:52.973649 15694 raft_consensus.cc:2781] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:34:52.973783 15694 raft_consensus.cc:482] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:34:52.973902 15694 raft_consensus.cc:3037] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:52.974228 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:52.964292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:41049 (local address 127.13.139.3:44029)
0810 18:34:52.964491 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:52.964497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:52.966091 (+ 1594us) server_negotiation.cc:407] Connection header received
0810 18:34:52.966251 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:52.966257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:52.966323 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:52.966418 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:52.967016 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.968291 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.970236 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:52.971581 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:52.971678 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:52.971726 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:52.972447 (+ 721us) server_negotiation.cc:299] Negotiation successful
0810 18:34:52.973810 (+ 1363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260810 18:34:52.975137 15613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae9effcdb4564a139019b75b94349dad" candidate_uuid: "60fd406928224280b6e745cc133b0a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" is_pre_election: true
I20260810 18:34:52.975694 15613 raft_consensus.cc:2454] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60fd406928224280b6e745cc133b0a3e in term 0.
I20260810 18:34:52.977012 15694 raft_consensus.cc:504] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.977681 15694 leader_election.cc:288] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [CANDIDATE]: Term 1 election: Requested vote from peers c59258f6f2864942ae0a88d0c44d869b (127.13.139.1:40715), f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3:44029)
I20260810 18:34:52.978087 15303 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae9effcdb4564a139019b75b94349dad" candidate_uuid: "60fd406928224280b6e745cc133b0a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c59258f6f2864942ae0a88d0c44d869b"
I20260810 18:34:52.978298 15303 raft_consensus.cc:3037] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:52.978231 15613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae9effcdb4564a139019b75b94349dad" candidate_uuid: "60fd406928224280b6e745cc133b0a3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3058ff37a344cf6a3e86107d6a70aa2"
I20260810 18:34:52.978447 15613 raft_consensus.cc:3037] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:52.981389 15613 raft_consensus.cc:2454] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fd406928224280b6e745cc133b0a3e in term 1.
I20260810 18:34:52.981660 15303 raft_consensus.cc:2454] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60fd406928224280b6e745cc133b0a3e in term 1.
I20260810 18:34:52.981750 15385 leader_election.cc:302] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60fd406928224280b6e745cc133b0a3e, f3058ff37a344cf6a3e86107d6a70aa2; no voters:
I20260810 18:34:52.982057 15694 raft_consensus.cc:2781] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:52.982672 15694 raft_consensus.cc:686] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 1 LEADER]: Becoming Leader. State: Replica: 60fd406928224280b6e745cc133b0a3e, State: Running, Role: LEADER
I20260810 18:34:52.983083 15694 consensus_queue.cc:237] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:52.986907 15124 catalog_manager.cc:5495] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60fd406928224280b6e745cc133b0a3e (127.13.139.2). New cstate: current_term: 1 leader_uuid: "60fd406928224280b6e745cc133b0a3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } health_report { overall_health: UNKNOWN } } }
Aug 10 18:34:53 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386890, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:53.087152 15729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.070168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46293 (local address 127.0.0.1:49942)
0810 18:34:53.070841 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:53.070862 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:53.071019 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:53.071533 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:53.071545 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:53.072386 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:53.072626 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.072638 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.073708 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.073713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.075288 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.075304 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.076575 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.076581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.076760 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.077458 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:53.077488 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:53.080402 (+ 2914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:53.084428 (+ 4026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:53.084440 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:53.084445 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:53.084898 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:53.085275 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:53.085279 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:53.085281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:53.085451 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:53.086026 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:53.086033 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:53.086183 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 18:34:53.086318 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 18:34:53.086658 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":334,"threads_started":1}
I20260810 18:34:53.087335 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.070168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49942 (local address 127.13.139.62:46293)
0810 18:34:53.071205 (+ 1037us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.071209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.071229 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:34:53.071275 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.071278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.071333 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.071493 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:53.072778 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.073582 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.075861 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.076405 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.076504 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.080576 (+ 4072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:53.080582 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:53.080586 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:53.080619 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:53.084294 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.085003 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.085010 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.085014 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.085168 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.085550 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.085554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.085558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.085877 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:53.086028 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.086445 (+ 417us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.086836 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":124,"server-negotiator.queue_time_us":940,"thread_start_us":801,"threads_started":1}
I20260810 18:34:53.093073 15124 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:49942:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 18:34:53.094316 15124 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:34:53.101236 15282 tablet_service.cc:1467] Processing CreateTablet for tablet 9ec3258b9c6b49d59c9236d0c8a02939 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=913d262f6b1644adbccc35696943a74a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:34:53.101449 15437 tablet_service.cc:1467] Processing CreateTablet for tablet 9ec3258b9c6b49d59c9236d0c8a02939 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=913d262f6b1644adbccc35696943a74a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:34:53.101845 15282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ec3258b9c6b49d59c9236d0c8a02939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:53.101694 15591 tablet_service.cc:1467] Processing CreateTablet for tablet 9ec3258b9c6b49d59c9236d0c8a02939 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=913d262f6b1644adbccc35696943a74a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:34:53.101979 15437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ec3258b9c6b49d59c9236d0c8a02939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:53.102257 15591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ec3258b9c6b49d59c9236d0c8a02939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:53.109827 15691 tablet_bootstrap.cc:492] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: Bootstrap starting.
I20260810 18:34:53.110469 15689 tablet_bootstrap.cc:492] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: Bootstrap starting.
I20260810 18:34:53.111267 15688 tablet_bootstrap.cc:492] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: Bootstrap starting.
I20260810 18:34:53.111734 15691 tablet_bootstrap.cc:654] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:53.112185 15689 tablet_bootstrap.cc:654] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:53.113224 15688 tablet_bootstrap.cc:654] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:53.122718 15691 tablet_bootstrap.cc:492] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: No bootstrap required, opened a new log
I20260810 18:34:53.123062 15691 ts_tablet_manager.cc:1397] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.011s
I20260810 18:34:53.124225 15691 raft_consensus.cc:348] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.124593 15691 raft_consensus.cc:374] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:53.124745 15691 raft_consensus.cc:729] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c59258f6f2864942ae0a88d0c44d869b, State: Initialized, Role: FOLLOWER
I20260810 18:34:53.125150 15691 consensus_queue.cc:260] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.125875 15691 ts_tablet_manager.cc:1428] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 18:34:53.125737 15695 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.126127 15695 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:53.128185 15688 tablet_bootstrap.cc:492] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: No bootstrap required, opened a new log
I20260810 18:34:53.129037 15688 ts_tablet_manager.cc:1397] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.002s
I20260810 18:34:53.130059 15688 raft_consensus.cc:348] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.130280 15688 raft_consensus.cc:374] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:53.130370 15688 raft_consensus.cc:729] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fd406928224280b6e745cc133b0a3e, State: Initialized, Role: FOLLOWER
I20260810 18:34:53.130668 15688 consensus_queue.cc:260] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.131099 15694 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.131402 15694 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:53.132071 15688 ts_tablet_manager.cc:1428] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 18:34:53.132604 15689 tablet_bootstrap.cc:492] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: No bootstrap required, opened a new log
I20260810 18:34:53.132757 15689 ts_tablet_manager.cc:1397] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.015s
I20260810 18:34:53.133464 15689 raft_consensus.cc:348] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.133719 15689 raft_consensus.cc:374] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:53.133800 15689 raft_consensus.cc:729] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3058ff37a344cf6a3e86107d6a70aa2, State: Initialized, Role: FOLLOWER
I20260810 18:34:53.134057 15689 consensus_queue.cc:260] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.134583 15689 ts_tablet_manager.cc:1428] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 18:34:53.134529 15697 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.134810 15697 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:53.296972 15695 raft_consensus.cc:482] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:34:53.297299 15695 raft_consensus.cc:504] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.299232 15695 leader_election.cc:288] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60fd406928224280b6e745cc133b0a3e (127.13.139.2:38825), f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3:44029)
I20260810 18:34:53.310397 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.299696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:50441 (local address 127.13.139.3:44029)
0810 18:34:53.299960 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.299971 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.304216 (+ 4245us) server_negotiation.cc:407] Connection header received
0810 18:34:53.304449 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.304455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.304559 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.304649 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:53.305363 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.306497 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.308454 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.309357 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.309526 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.309603 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.309952 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.310115 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:34:53.310688 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.299728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:38825 (local address 127.13.139.1:58743)
0810 18:34:53.304377 (+ 4649us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:53.304392 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:53.304498 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:53.304834 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:53.304839 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:53.304883 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:53.305366 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.305377 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.306856 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.306863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.308535 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.308547 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.309905 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.309910 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.310047 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.310068 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 18:34:53.310167 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 18:34:53.310290 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4546,"mutex_wait_us":21,"thread_start_us":4118,"threads_started":1}
I20260810 18:34:53.310688 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.299619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:58743 (local address 127.13.139.2:38825)
0810 18:34:53.303944 (+ 4325us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.303953 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.304462 (+ 509us) server_negotiation.cc:407] Connection header received
0810 18:34:53.304602 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.304609 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.304687 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.304800 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:53.305518 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.306665 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.308686 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.309526 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.309701 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.309802 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.310193 (+ 391us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.310355 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4146,"thread_start_us":3989,"threads_started":1}
I20260810 18:34:53.310897 15735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.299709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:44029 (local address 127.13.139.1:50441)
0810 18:34:53.304085 (+ 4376us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:53.304104 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:53.304295 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:53.304652 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:53.304655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:53.304676 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:53.305182 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.305200 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.306693 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.306700 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.308304 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.308317 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.309559 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.309564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.309731 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.309795 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 18:34:53.309925 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 18:34:53.310125 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4248,"mutex_wait_us":17,"spinlock_wait_cycles":70912,"thread_start_us":4405,"threads_started":1}
I20260810 18:34:53.311515 15613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ec3258b9c6b49d59c9236d0c8a02939" candidate_uuid: "c59258f6f2864942ae0a88d0c44d869b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" is_pre_election: true
I20260810 18:34:53.311481 15463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ec3258b9c6b49d59c9236d0c8a02939" candidate_uuid: "c59258f6f2864942ae0a88d0c44d869b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fd406928224280b6e745cc133b0a3e" is_pre_election: true
I20260810 18:34:53.311761 15613 raft_consensus.cc:2454] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59258f6f2864942ae0a88d0c44d869b in term 0.
I20260810 18:34:53.311769 15463 raft_consensus.cc:2454] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c59258f6f2864942ae0a88d0c44d869b in term 0.
I20260810 18:34:53.312271 15228 leader_election.cc:302] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59258f6f2864942ae0a88d0c44d869b, f3058ff37a344cf6a3e86107d6a70aa2; no voters:
I20260810 18:34:53.312680 15695 raft_consensus.cc:2781] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:34:53.312808 15695 raft_consensus.cc:482] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:34:53.312917 15695 raft_consensus.cc:3037] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:53.314986 15695 raft_consensus.cc:504] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.315544 15695 leader_election.cc:288] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [CANDIDATE]: Term 1 election: Requested vote from peers 60fd406928224280b6e745cc133b0a3e (127.13.139.2:38825), f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3:44029)
I20260810 18:34:53.315939 15463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ec3258b9c6b49d59c9236d0c8a02939" candidate_uuid: "c59258f6f2864942ae0a88d0c44d869b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fd406928224280b6e745cc133b0a3e"
I20260810 18:34:53.316025 15613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ec3258b9c6b49d59c9236d0c8a02939" candidate_uuid: "c59258f6f2864942ae0a88d0c44d869b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3058ff37a344cf6a3e86107d6a70aa2"
I20260810 18:34:53.316138 15463 raft_consensus.cc:3037] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:53.316251 15613 raft_consensus.cc:3037] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:53.318179 15613 raft_consensus.cc:2454] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59258f6f2864942ae0a88d0c44d869b in term 1.
I20260810 18:34:53.318236 15463 raft_consensus.cc:2454] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c59258f6f2864942ae0a88d0c44d869b in term 1.
I20260810 18:34:53.318588 15228 leader_election.cc:302] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c59258f6f2864942ae0a88d0c44d869b, f3058ff37a344cf6a3e86107d6a70aa2; no voters:
I20260810 18:34:53.318881 15695 raft_consensus.cc:2781] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:53.319257 15695 raft_consensus.cc:686] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [term 1 LEADER]: Becoming Leader. State: Replica: c59258f6f2864942ae0a88d0c44d869b, State: Running, Role: LEADER
I20260810 18:34:53.319648 15695 consensus_queue.cc:237] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } }
I20260810 18:34:53.321674 15736 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: TxnStatusTablet state changed. Reason: New leader c59258f6f2864942ae0a88d0c44d869b. Latest consensus state: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.322207 15736 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:34:53.322995 15738 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 18:34:53.323292 15738 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 18:34:53.323959 15124 catalog_manager.cc:5495] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b reported cstate change: term changed from 0 to 1, leader changed from <none> to c59258f6f2864942ae0a88d0c44d869b (127.13.139.1). New cstate: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } health_report { overall_health: UNKNOWN } } }
I20260810 18:34:53.366690 15729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.360799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40715 (local address 127.0.0.1:34986)
0810 18:34:53.361044 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:53.361067 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:53.361195 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:53.361751 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:53.361755 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:53.361765 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:34:53.361925 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.361932 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.363194 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.363202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.364258 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.364270 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.365024 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.365031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.365194 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.365249 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:34:53.366092 (+ 843us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:34:53.366114 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 18:34:53.366201 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 18:34:53.366345 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 18:34:53.366719 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.360837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34986 (local address 127.13.139.1:40715)
0810 18:34:53.361082 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.361090 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.361136 (+ 46us) server_negotiation.cc:407] Connection header received
0810 18:34:53.361419 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.361428 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.361568 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.361735 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:53.362068 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.363066 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.364407 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.364860 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.365007 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.365437 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:53.365977 (+ 540us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:53.366135 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.366227 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.366316 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260810 18:34:53.371918 15463 raft_consensus.cc:1261] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Refusing update from remote peer c59258f6f2864942ae0a88d0c44d869b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:53.372303 15613 raft_consensus.cc:1261] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Refusing update from remote peer c59258f6f2864942ae0a88d0c44d869b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:53.372697 15736 consensus_queue.cc:1035] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:53.373034 15695 consensus_queue.cc:1035] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:53.376919 15694 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: TxnStatusTablet state changed. Reason: New leader c59258f6f2864942ae0a88d0c44d869b. Latest consensus state: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.377242 15694 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:53.380242 15695 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.380519 15695 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:34:53.380934 15742 mvcc.cc:205] Tried to move back new op lower bound from 7317040715243724800 to 7317040715040776192. Current Snapshot: MvccSnapshot[applied={T|T < 7317040715243724800}]
I20260810 18:34:53.385020 15694 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.385402 15694 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P 60fd406928224280b6e745cc133b0a3e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:53.392844 15697 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: TxnStatusTablet state changed. Reason: New leader c59258f6f2864942ae0a88d0c44d869b. Latest consensus state: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.393153 15697 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:53.393898 15695 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.394168 15695 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P c59258f6f2864942ae0a88d0c44d869b: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:34:53.397517 15697 tablet_replica.cc:439] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c59258f6f2864942ae0a88d0c44d869b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 } } peers { permanent_uuid: "60fd406928224280b6e745cc133b0a3e" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 38825 } } peers { permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 } } }
I20260810 18:34:53.397780 15697 tablet_replica.cc:442] T 9ec3258b9c6b49d59c9236d0c8a02939 P f3058ff37a344cf6a3e86107d6a70aa2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:53.399739 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.390572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60786 (local address 127.13.139.2:38825)
0810 18:34:53.391041 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.391048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.391350 (+ 302us) server_negotiation.cc:407] Connection header received
0810 18:34:53.391598 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.391604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.391715 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.391883 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:53.392483 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.393655 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.396862 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.397525 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.397622 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.398293 (+ 671us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:53.399041 (+ 748us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:53.399192 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.399310 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.399449 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254}
I20260810 18:34:53.417572 15756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.410686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40715 (local address 127.13.139.2:57085)
0810 18:34:53.411412 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:53.411471 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:53.411591 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:53.411942 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:53.411974 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:53.411988 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:34:53.412744 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.412756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.414253 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.414256 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.415397 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.415409 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.416513 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.416517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.416625 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.416671 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:34:53.417086 (+ 415us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:34:53.417101 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 18:34:53.417153 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 18:34:53.417264 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":422,"threads_started":1}
I20260810 18:34:53.417637 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.410712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:57085 (local address 127.13.139.1:40715)
0810 18:34:53.410914 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.410920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.411549 (+ 629us) server_negotiation.cc:407] Connection header received
0810 18:34:53.411701 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.411706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.411827 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.411920 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:53.412898 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.414126 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.415594 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.416346 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.416471 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.416825 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:53.416967 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:53.417063 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.417194 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.417294 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:34:53.428315 15303 raft_consensus.cc:1261] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Refusing update from remote peer 60fd406928224280b6e745cc133b0a3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:53.428462 15613 raft_consensus.cc:1261] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Refusing update from remote peer 60fd406928224280b6e745cc133b0a3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:53.429056 15721 consensus_queue.cc:1035] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c59258f6f2864942ae0a88d0c44d869b" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:53.429710 15694 consensus_queue.cc:1035] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3058ff37a344cf6a3e86107d6a70aa2" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:53.486544 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.474668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:60139 (local address 127.13.139.2:38825)
0810 18:34:53.474812 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.474816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.480170 (+ 5354us) server_negotiation.cc:407] Connection header received
0810 18:34:53.480402 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.480408 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.480496 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.480589 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:53.481287 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.482378 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.484518 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.485256 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.485406 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.485810 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:53.485964 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:53.486069 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.486178 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.486264 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 18:34:53.486609 15760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.474755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:38825 (local address 127.13.139.1:60139)
0810 18:34:53.480060 (+ 5305us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:53.480080 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:53.480229 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:53.480611 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:53.480631 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:53.480646 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:34:53.481046 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.481060 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.482493 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.482497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.484351 (+ 1854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:53.484368 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.485450 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.485455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:53.485588 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.485641 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:34:53.486063 (+ 422us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:34:53.486071 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 18:34:53.486129 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 18:34:53.486233 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5096,"thread_start_us":4856,"threads_started":1}
I20260810 18:34:53.536837 15128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:34:53.537113 15128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:34:53.540586 15128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd4b9adebd664779a036c956c1473b04: Sending DeleteTablet for 3 replicas of tablet ae9effcdb4564a139019b75b94349dad
I20260810 18:34:53.541687 15282 tablet_service.cc:1514] Processing DeleteTablet for tablet ae9effcdb4564a139019b75b94349dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:53 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:34974
I20260810 18:34:53.541767 15591 tablet_service.cc:1514] Processing DeleteTablet for tablet ae9effcdb4564a139019b75b94349dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:53 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:50706
I20260810 18:34:53.542212 15437 tablet_service.cc:1514] Processing DeleteTablet for tablet ae9effcdb4564a139019b75b94349dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:53 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:60778
I20260810 18:34:53.547963 15770 tablet_replica.cc:330] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: stopping tablet replica
I20260810 18:34:53.548291 15770 raft_consensus.cc:2229] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:34:53.549011 15770 raft_consensus.cc:2258] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:53.554085 15767 tablet_replica.cc:330] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: stopping tablet replica
I20260810 18:34:53.554435 15767 raft_consensus.cc:2229] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:34:53.554833 15767 raft_consensus.cc:2258] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:53.556077 15767 ts_tablet_manager.cc:1905] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:53.556439 15770 ts_tablet_manager.cc:1905] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:53.563736 15767 ts_tablet_manager.cc:1918] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:34:53.563959 15767 log.cc:1196] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/ae9effcdb4564a139019b75b94349dad
I20260810 18:34:53.564572 15767 ts_tablet_manager.cc:1939] T ae9effcdb4564a139019b75b94349dad P c59258f6f2864942ae0a88d0c44d869b: Deleting consensus metadata
I20260810 18:34:53.565835 15111 catalog_manager.cc:4841] TS c59258f6f2864942ae0a88d0c44d869b (127.13.139.1:40715): tablet ae9effcdb4564a139019b75b94349dad (table test-table [id=a2a8cc6688eb4375b162451bc0f9b699]) successfully deleted
I20260810 18:34:53.566815 15770 ts_tablet_manager.cc:1918] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:34:53.566996 15770 log.cc:1196] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/ae9effcdb4564a139019b75b94349dad
I20260810 18:34:53.567473 15770 ts_tablet_manager.cc:1939] T ae9effcdb4564a139019b75b94349dad P 60fd406928224280b6e745cc133b0a3e: Deleting consensus metadata
I20260810 18:34:53.568749 15108 catalog_manager.cc:4841] TS 60fd406928224280b6e745cc133b0a3e (127.13.139.2:38825): tablet ae9effcdb4564a139019b75b94349dad (table test-table [id=a2a8cc6688eb4375b162451bc0f9b699]) successfully deleted
I20260810 18:34:53.569092 15769 tablet_replica.cc:330] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: stopping tablet replica
I20260810 18:34:53.569314 15769 raft_consensus.cc:2229] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:34:53.569598 15769 raft_consensus.cc:2258] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:53.570814 15769 ts_tablet_manager.cc:1905] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:53.577874 15769 ts_tablet_manager.cc:1918] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:34:53.578891 15769 log.cc:1196] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/ae9effcdb4564a139019b75b94349dad
I20260810 18:34:53.581444 15769 ts_tablet_manager.cc:1939] T ae9effcdb4564a139019b75b94349dad P f3058ff37a344cf6a3e86107d6a70aa2: Deleting consensus metadata
I20260810 18:34:53.582651 15111 catalog_manager.cc:4841] TS f3058ff37a344cf6a3e86107d6a70aa2 (127.13.139.3:44029): tablet ae9effcdb4564a139019b75b94349dad (table test-table [id=a2a8cc6688eb4375b162451bc0f9b699]) successfully deleted
Aug 10 18:34:53 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:34:53.598706 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.568248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35002 (local address 127.13.139.1:40715)
0810 18:34:53.568420 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.568428 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.578673 (+ 10245us) server_negotiation.cc:407] Connection header received
0810 18:34:53.578871 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.578877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.578974 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.579083 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:53.581151 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.582738 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.584850 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.585528 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.585661 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.590911 (+ 5250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:53.590923 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:53.590941 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:53.590989 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:53.595493 (+ 4504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.596365 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.596378 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.596382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.596550 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.596984 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.596989 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.596992 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.597441 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:53.597782 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.598066 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.598288 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 18:34:53.599632 15351 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35002
I20260810 18:34:53.634517 15775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.604659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49954 (local address 127.13.139.62:46293)
0810 18:34:53.617012 (+ 12353us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.617019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.617773 (+ 754us) server_negotiation.cc:407] Connection header received
0810 18:34:53.617847 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.617852 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.617937 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.618039 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:53.620217 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.621448 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.623370 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.624106 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.624208 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.627679 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:53.627686 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:53.627691 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:53.627747 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:53.631406 (+ 3659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.632215 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.632221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.632224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.632378 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.632856 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.632862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.632865 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.633234 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:53.633500 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.633884 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.634140 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12203,"thread_start_us":12359,"threads_started":1}
W20260810 18:34:53.635265 15128 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49954
I20260810 18:34:53.637845 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15210
I20260810 18:34:53.668309 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.640883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35008 (local address 127.13.139.1:40715)
0810 18:34:53.641062 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.641068 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.650044 (+ 8976us) server_negotiation.cc:407] Connection header received
0810 18:34:53.650361 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.650368 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.650464 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.650556 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:53.652737 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.653929 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.656079 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.656958 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.657078 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.660696 (+ 3618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:53.660703 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:53.660708 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:53.660755 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:53.664881 (+ 4126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.665768 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.665774 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.665778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.665956 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.666450 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.666456 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.666460 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.666788 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:53.667027 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.667646 (+ 619us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.667893 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260810 18:34:53.669976 15351 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35008
W20260810 18:34:53.670599 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15210: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:34:53.670782 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 15210
I20260810 18:34:53.701275 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15365
Aug 10 18:34:53 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:34:53.719738 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.702125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60792 (local address 127.13.139.2:38825)
0810 18:34:53.702295 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.702299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.702317 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:34:53.702525 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.702529 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.702592 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.702675 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:53.704185 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.704928 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.706794 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.707264 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.707354 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.712563 (+ 5209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:53.712581 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:53.712601 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:53.712643 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:53.716781 (+ 4138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.717404 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.717413 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.717417 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.717618 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.718000 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.718006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.718009 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.718549 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:53.718841 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.719077 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.719313 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260810 18:34:53.720477 15508 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60792
W20260810 18:34:53.721154 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15365: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:34:53.721366 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 15365
I20260810 18:34:53.742868 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15518
Aug 10 18:34:53 dist-test-slave-5k54 krb5kdc[15078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386892, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:34:53.757764 15686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:53.743653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.13.139.3:44029)
0810 18:34:53.743882 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:53.743890 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:53.743911 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:34:53.744093 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:53.744098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:53.744179 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:53.744283 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:53.745553 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.746284 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.747650 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:53.748096 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:53.748239 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:53.752257 (+ 4018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:53.752271 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:53.752287 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:53.752320 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:53.754926 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.755749 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.755756 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.755758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.755900 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:53.756270 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:53.756273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:53.756275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:53.756656 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:53.756968 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:53.757217 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 18:34:53.757444 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260810 18:34:53.758463 15659 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50726
W20260810 18:34:53.759109 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15518: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:34:53.759265 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 15518
I20260810 18:34:53.783519 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15092
I20260810 18:34:53.784667 15173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:34:53.898406 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 15092
2026-08-10T18:34:53Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5266 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:34:53 dist-test-slave-5k54 krb5kdc[15780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:34:54 dist-test-slave-5k54 krb5kdc[15780](info): set up 2 sockets
Aug 10 18:34:54 dist-test-slave-5k54 krb5kdc[15780](info): commencing operation
krb5kdc: starting...
W20260810 18:34:55.045956 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260810 18:34:55.278584 13868 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.146s user 0.000s sys 0.006s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260810 18:34:55.479543 13868 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.201s user 0.000s sys 0.007s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/test-user.keytab.
W20260810 18:34:56.331326 13868 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.852s user 0.000s sys 0.006s
Aug 10 18:34:56 dist-test-slave-5k54 krb5kdc[15780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:34:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:34:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
W20260810 18:34:56.963862 13868 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.13.139.62: real 0.576s user 0.000s sys 0.011s
I20260810 18:34:56.964986 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:35221
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:35221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:57.289197 15795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:57.289623 15795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:57.289848 15795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:57.297333 15795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:34:57.297425 15795 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 18:34:57.297465 15795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:57.297530 15795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:57.297577 15795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:34:57.297636 15795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:34:57.307312 15795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:35221
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:35221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:57.308574 15795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:57.310040 15795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:57.327749 15801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:57.327852 15802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:57.327805 15804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:57.328773 15795 server_base.cc:1034] running on GCE node
I20260810 18:34:57.329499 15795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:57.330837 15795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:57.332062 15795 hybrid_clock.cc:648] HybridClock initialized: now 1786386897332001 us; error 28 us; skew 500 ppm
I20260810 18:34:57.332352 15795 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:57 dist-test-slave-5k54 krb5kdc[15780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386897, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:57.338256 15795 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:34:57.339691 15795 webserver.cc:460] Webserver started at http://127.13.139.62:40249/ using document root <none> and password file <none>
I20260810 18:34:57.340415 15795 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:57.340502 15795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:57.340764 15795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:57.343748 15795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72"
format_stamp: "Formatted at 2026-08-10 18:34:57 on dist-test-slave-5k54"
server_key: "12027cff4c21919ac8662dd7106aa41b"
server_key_iv: "13c094daad4309fe7ca6f9be4069d36e"
server_key_version: "encryptionkey@0"
I20260810 18:34:57.344461 15795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72"
format_stamp: "Formatted at 2026-08-10 18:34:57 on dist-test-slave-5k54"
server_key: "12027cff4c21919ac8662dd7106aa41b"
server_key_iv: "13c094daad4309fe7ca6f9be4069d36e"
server_key_version: "encryptionkey@0"
I20260810 18:34:57.349429 15795 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260810 18:34:57.352751 15811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:57.354048 15795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:34:57.354212 15795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72"
format_stamp: "Formatted at 2026-08-10 18:34:57 on dist-test-slave-5k54"
server_key: "12027cff4c21919ac8662dd7106aa41b"
server_key_iv: "13c094daad4309fe7ca6f9be4069d36e"
server_key_version: "encryptionkey@0"
I20260810 18:34:57.354410 15795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:57.382895 15795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:57.386806 15795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:57.387087 15795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:57.408545 15795 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:35221
I20260810 18:34:57.408563 15879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:35221 every 8 connection(s)
I20260810 18:34:57.409888 15795 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:34:57.413585 15880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:57.414691 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 15795
I20260810 18:34:57.414901 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:34:57.415635 13868 external_mini_cluster.cc:1428] Setting key 382856d5660bbbb0e24c07fd3a408e31
I20260810 18:34:57.427556 15880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Bootstrap starting.
Aug 10 18:34:57 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:57.431291 15880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:57.432577 15880 log.cc:824] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:57.435640 15880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: No bootstrap required, opened a new log
I20260810 18:34:57.438651 15883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:57.417586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50258 (local address 127.13.139.62:35221)
0810 18:34:57.418401 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:57.418411 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:57.418454 (+ 43us) server_negotiation.cc:407] Connection header received
0810 18:34:57.420115 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:57.420136 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:57.420501 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:57.420813 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:57.422629 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:57.423985 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:57.425772 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:57.426397 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:57.426525 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:57.431147 (+ 4622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:57.431155 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:57.431168 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:57.431206 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:57.434614 (+ 3408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:57.435262 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:57.435271 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:57.435278 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:57.435513 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:57.435956 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:57.435961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:57.435965 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:57.436479 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:57.436786 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:57.437237 (+ 451us) server_negotiation.cc:299] Negotiation successful
0810 18:34:57.437656 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":404,"threads_started":1}
I20260810 18:34:57.444025 15880 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35221 } }
I20260810 18:34:57.444391 15880 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:57.444497 15880 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a083cbf0a6648f2b5c5ff48d9b4fa72, State: Initialized, Role: FOLLOWER
I20260810 18:34:57.445081 15880 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35221 } }
I20260810 18:34:57.445327 15880 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:34:57.445461 15880 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:34:57.445631 15880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:57.448272 15880 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35221 } }
I20260810 18:34:57.448765 15880 leader_election.cc:302] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a083cbf0a6648f2b5c5ff48d9b4fa72; no voters:
I20260810 18:34:57.449335 15880 leader_election.cc:288] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:34:57.449463 15885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:57.450163 15885 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [term 1 LEADER]: Becoming Leader. State: Replica: 5a083cbf0a6648f2b5c5ff48d9b4fa72, State: Running, Role: LEADER
I20260810 18:34:57.450774 15885 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35221 } }
I20260810 18:34:57.451370 15880 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:34:57.453460 15888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a083cbf0a6648f2b5c5ff48d9b4fa72. Latest consensus state: current_term: 1 leader_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35221 } } }
I20260810 18:34:57.453833 15888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:57.455715 15893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:34:57.460636 15893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:34:57.464223 15886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a083cbf0a6648f2b5c5ff48d9b4fa72" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35221 } } }
I20260810 18:34:57.464802 15886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72 [sys.catalog]: This master's current role is: LEADER
I20260810 18:34:57.470920 15893 catalog_manager.cc:1347] Generated new cluster ID: 049af1f2f2324d269a3219677d0b9f0d
I20260810 18:34:57.471033 15893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:34:57.484268 15893 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:34:57.485576 15893 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:34:57.495545 15893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Generated new TSK 0
I20260810 18:34:57.496367 15893 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:34:57.562774 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35221
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:57.904204 15912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:57.904500 15912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:57.904601 15912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:57.911639 15912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:57.911742 15912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:57.911832 15912 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 18:34:57.911885 15912 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:34:57.911962 15912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:34:57.921782 15912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:57.922996 15912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:57.924355 15912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:57.937845 15917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:57.937937 15921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:57.938294 15912 server_base.cc:1034] running on GCE node
W20260810 18:34:57.938367 15918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:57.939148 15912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:57.940253 15912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:57.941471 15912 hybrid_clock.cc:648] HybridClock initialized: now 1786386897941421 us; error 42 us; skew 500 ppm
I20260810 18:34:57.941776 15912 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:57 dist-test-slave-5k54 krb5kdc[15780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386897, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:57.944998 15912 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:34:57.946422 15912 webserver.cc:460] Webserver started at http://127.13.139.1:42535/ using document root <none> and password file <none>
I20260810 18:34:57.947034 15912 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:57.947167 15912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:57.947508 15912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:57.950328 15912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "c887ee0c072d4bb4b879027275a8e51c"
format_stamp: "Formatted at 2026-08-10 18:34:57 on dist-test-slave-5k54"
server_key: "87f9b6fa64c15c77eb7d90f563ffdbf6"
server_key_iv: "10a488c7c8752b12ffb19008084338c6"
server_key_version: "encryptionkey@0"
I20260810 18:34:57.951022 15912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "c887ee0c072d4bb4b879027275a8e51c"
format_stamp: "Formatted at 2026-08-10 18:34:57 on dist-test-slave-5k54"
server_key: "87f9b6fa64c15c77eb7d90f563ffdbf6"
server_key_iv: "10a488c7c8752b12ffb19008084338c6"
server_key_version: "encryptionkey@0"
I20260810 18:34:57.956372 15912 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260810 18:34:57.959798 15928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:57.961082 15912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:34:57.961213 15912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "c887ee0c072d4bb4b879027275a8e51c"
format_stamp: "Formatted at 2026-08-10 18:34:57 on dist-test-slave-5k54"
server_key: "87f9b6fa64c15c77eb7d90f563ffdbf6"
server_key_iv: "10a488c7c8752b12ffb19008084338c6"
server_key_version: "encryptionkey@0"
I20260810 18:34:57.961372 15912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:57.981245 15912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:57.984941 15912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:57.985176 15912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:57.987709 15912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:57.987838 15912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:57.987979 15912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:57.988065 15912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:34:57 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386897, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:58.012012 15937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:57.988113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:43317 (local address 127.13.139.62:35221)
0810 18:34:57.988613 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:57.988621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:57.989702 (+ 1081us) server_negotiation.cc:407] Connection header received
0810 18:34:57.991809 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:57.991816 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:57.991892 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:57.992008 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:57.993940 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:57.995229 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:57.998242 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:57.998981 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:57.999153 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.004062 (+ 4909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:58.004071 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:58.004078 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:58.004136 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:58.008376 (+ 4240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.009150 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.009159 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.009165 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.009361 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.009817 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.009825 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.009831 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.010310 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:58.010521 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:58.011209 (+ 688us) server_negotiation.cc:299] Negotiation successful
0810 18:34:58.011541 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":247,"threads_started":1}
I20260810 18:34:58.013341 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:57.988793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35221 (local address 127.13.139.1:43317)
0810 18:34:57.989547 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:57.989583 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:57.991480 (+ 1897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:57.992245 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:57.992253 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:57.992803 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:57.993726 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:57.993753 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:57.995462 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:57.995469 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:57.998023 (+ 2554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:57.998046 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:57.999268 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:57.999278 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:57.999640 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.000565 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:58.000597 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:58.003692 (+ 3095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:58.008558 (+ 4866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.008568 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.008585 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.009006 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.009485 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.009488 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.009490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.009698 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.010466 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:58.010471 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:58.010817 (+ 346us) client_negotiation.cc:769] Sending connection context
0810 18:34:58.011046 (+ 229us) client_negotiation.cc:240] Negotiation successful
0810 18:34:58.011501 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":327,"threads_started":1}
I20260810 18:34:58.034353 15937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:58.019813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:48077 (local address 127.13.139.62:35221)
0810 18:34:58.020001 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:58.020005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:58.020898 (+ 893us) server_negotiation.cc:407] Connection header received
0810 18:34:58.021107 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:58.021112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:58.021184 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:58.021282 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:58.022219 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.022909 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.024608 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.025481 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.025653 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.027406 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:58.027415 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:58.027457 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:58.027508 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:58.031357 (+ 3849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.032388 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.032397 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.032401 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.032545 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.032912 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.032918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.032921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.033196 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:58.033374 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:58.033769 (+ 395us) server_negotiation.cc:299] Negotiation successful
0810 18:34:58.033990 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 18:34:58.034446 16017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:58.019911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35221 (local address 127.13.139.1:48077)
0810 18:34:58.020777 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:58.020802 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:58.020968 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:58.021303 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:58.021307 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:58.021757 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:58.022047 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:58.022056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.023035 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.023042 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:58.024429 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:58.024447 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.025668 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.025673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:58.025782 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.026445 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:58.026462 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:58.027188 (+ 726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:58.031585 (+ 4397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.031591 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.031596 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.032260 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.032655 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.032659 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.032662 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.032803 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.033316 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:58.033321 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:58.033503 (+ 182us) client_negotiation.cc:769] Sending connection context
0810 18:34:58.033652 (+ 149us) client_negotiation.cc:240] Negotiation successful
0810 18:34:58.033977 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":497,"threads_started":1}
I20260810 18:34:58.047953 15912 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:34677
I20260810 18:34:58.047986 16062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:34677 every 8 connection(s)
I20260810 18:34:58.049170 15912 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:34:58.051198 16063 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35221
I20260810 18:34:58.051465 16063 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:58.052151 16063 heartbeater.cc:511] Master 127.13.139.62:35221 requested a full tablet report, sending...
I20260810 18:34:58.054061 15828 ts_manager.cc:194] Registered new tserver with Master: c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677)
I20260810 18:34:58.055541 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 15912
I20260810 18:34:58.055517 15828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:43317
I20260810 18:34:58.055738 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:34:58.056372 13868 external_mini_cluster.cc:1428] Setting key add39cd04eeb765dc157badf49d5f1dc
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:34:58.102773 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35221
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:58.423394 16069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:58.423704 16069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:58.423890 16069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:58.431047 16069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:58.431180 16069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:58.431344 16069 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 18:34:58.431427 16069 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:34:58.431573 16069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:34:58.441273 16069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:58.442586 16069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:58.444008 16069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:58.457393 16077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:58.457352 16074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:58.457491 16075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:58.458336 16069 server_base.cc:1034] running on GCE node
I20260810 18:34:58.459227 16069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:58.460242 16069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:58.461434 16069 hybrid_clock.cc:648] HybridClock initialized: now 1786386898461381 us; error 48 us; skew 500 ppm
I20260810 18:34:58.461699 16069 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:58 dist-test-slave-5k54 krb5kdc[15780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386898, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:58.464939 16069 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:34:58.466445 16069 webserver.cc:460] Webserver started at http://127.13.139.2:36011/ using document root <none> and password file <none>
I20260810 18:34:58.467183 16069 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:58.467325 16069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:58.467724 16069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:58.470728 16069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "16c4566888d34b76bbda03de3118c611"
format_stamp: "Formatted at 2026-08-10 18:34:58 on dist-test-slave-5k54"
server_key: "094f7abbf04e47f64db89ad693a1d2d4"
server_key_iv: "c4d1924b260e2a6a332da4008af140cf"
server_key_version: "encryptionkey@0"
I20260810 18:34:58.471621 16069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "16c4566888d34b76bbda03de3118c611"
format_stamp: "Formatted at 2026-08-10 18:34:58 on dist-test-slave-5k54"
server_key: "094f7abbf04e47f64db89ad693a1d2d4"
server_key_iv: "c4d1924b260e2a6a332da4008af140cf"
server_key_version: "encryptionkey@0"
I20260810 18:34:58.477324 16069 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:34:58.480976 16084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:58.482331 16069 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:34:58.482501 16069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "16c4566888d34b76bbda03de3118c611"
format_stamp: "Formatted at 2026-08-10 18:34:58 on dist-test-slave-5k54"
server_key: "094f7abbf04e47f64db89ad693a1d2d4"
server_key_iv: "c4d1924b260e2a6a332da4008af140cf"
server_key_version: "encryptionkey@0"
I20260810 18:34:58.482687 16069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:58.497049 16069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:58.500928 16069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:58.501236 16069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:58.503890 16069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:58.504016 16069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:58.504149 16069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:58.504318 16069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 10 18:34:58 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386898, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:58.527824 15937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:58.504363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:45757 (local address 127.13.139.62:35221)
0810 18:34:58.504562 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:58.504570 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:58.506042 (+ 1472us) server_negotiation.cc:407] Connection header received
0810 18:34:58.508287 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:58.508293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:58.508388 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:58.508494 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:58.510860 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.512213 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.513832 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.514638 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.514795 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.519623 (+ 4828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:58.519632 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:58.519657 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:58.519711 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:58.523837 (+ 4126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.524871 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.524875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.524878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.525001 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.525622 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.525628 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.525634 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.526062 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:58.526233 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:58.527182 (+ 949us) server_negotiation.cc:299] Negotiation successful
0810 18:34:58.527419 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 18:34:58.528921 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:58.505077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35221 (local address 127.13.139.2:45757)
0810 18:34:58.505872 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:58.505916 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:58.507943 (+ 2027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:58.508787 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:58.508803 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:58.509682 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:58.510559 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:58.510581 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.512382 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.512388 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:58.513684 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:58.513697 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.514927 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.514937 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:58.515243 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.516139 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:58.516178 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:58.519358 (+ 3180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:58.524005 (+ 4647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.524014 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.524033 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.524676 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.525184 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.525192 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.525195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.525489 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.526213 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:58.526221 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:58.526717 (+ 496us) client_negotiation.cc:769] Sending connection context
0810 18:34:58.527102 (+ 385us) client_negotiation.cc:240] Negotiation successful
0810 18:34:58.527715 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":353,"threads_started":1}
I20260810 18:34:58.550761 15937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:58.535484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:50513 (local address 127.13.139.62:35221)
0810 18:34:58.535666 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:58.535673 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:58.536484 (+ 811us) server_negotiation.cc:407] Connection header received
0810 18:34:58.536618 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:58.536625 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:58.536715 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:58.536823 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:58.537703 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.539190 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.540907 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.541677 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.541825 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.544385 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:58.544394 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:58.544402 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:58.544462 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:58.548111 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.548784 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.548789 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.548792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.548931 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:58.549313 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:58.549319 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:58.549322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:58.549648 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:58.549804 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:58.550197 (+ 393us) server_negotiation.cc:299] Negotiation successful
0810 18:34:58.550417 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:34:58.550902 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:58.535560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35221 (local address 127.13.139.2:50513)
0810 18:34:58.536387 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:58.536403 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:58.536509 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:58.536869 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:58.536874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:58.537284 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:58.537560 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:58.537568 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.539354 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.539358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:58.540758 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:58.540771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:58.541912 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:58.541921 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:58.542159 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:58.542877 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:58.542907 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:58.544182 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:58.548254 (+ 4072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.548261 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.548265 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.548661 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.549057 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:58.549064 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:58.549068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:58.549201 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:58.549769 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:58.549774 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:58.549958 (+ 184us) client_negotiation.cc:769] Sending connection context
0810 18:34:58.550089 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 18:34:58.550425 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":466,"threads_started":1}
I20260810 18:34:58.561697 16069 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:45423
I20260810 18:34:58.561745 16214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:45423 every 8 connection(s)
I20260810 18:34:58.562963 16069 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:34:58.564980 16215 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35221
I20260810 18:34:58.565218 16215 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:58.565914 16215 heartbeater.cc:511] Master 127.13.139.62:35221 requested a full tablet report, sending...
I20260810 18:34:58.567308 15828 ts_manager.cc:194] Registered new tserver with Master: 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423)
I20260810 18:34:58.568219 15828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:45757
I20260810 18:34:58.573261 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 16069
I20260810 18:34:58.573433 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:34:58.573875 13868 external_mini_cluster.cc:1428] Setting key 23655091da646ddc6792b0fcb98bf8fe
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:34:58.618964 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35221
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:34:58.955842 16219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:34:58.956122 16219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:34:58.956307 16219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:34:58.963825 16219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:34:58.963949 16219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:34:58.964109 16219 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 18:34:58.964190 16219 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:34:58.964298 16219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:34:58.974100 16219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:34:58.975474 16219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:34:58.976845 16219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:34:58.990262 16224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:58.990183 16225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:34:58.990221 16228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:34:58.991158 16219 server_base.cc:1034] running on GCE node
I20260810 18:34:58.991870 16219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:34:58.992843 16219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:34:58.994046 16219 hybrid_clock.cc:648] HybridClock initialized: now 1786386898994001 us; error 35 us; skew 500 ppm
I20260810 18:34:58.994369 16219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:34:58 dist-test-slave-5k54 krb5kdc[15780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386898, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:34:58.997596 16219 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:34:58.998971 16219 webserver.cc:460] Webserver started at http://127.13.139.3:42751/ using document root <none> and password file <none>
I20260810 18:34:58.999709 16219 fs_manager.cc:359] Metadata directory not provided
I20260810 18:34:58.999816 16219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:34:59.000089 16219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:34:59.002978 16219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "b25d4ec32b204239b863eb6cfc62c679"
format_stamp: "Formatted at 2026-08-10 18:34:58 on dist-test-slave-5k54"
server_key: "560530efc8a4c636197f3b1fc1e09fa4"
server_key_iv: "ad65877a0089188b92ab5e9e9439e9f2"
server_key_version: "encryptionkey@0"
I20260810 18:34:59.003788 16219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "b25d4ec32b204239b863eb6cfc62c679"
format_stamp: "Formatted at 2026-08-10 18:34:58 on dist-test-slave-5k54"
server_key: "560530efc8a4c636197f3b1fc1e09fa4"
server_key_iv: "ad65877a0089188b92ab5e9e9439e9f2"
server_key_version: "encryptionkey@0"
I20260810 18:34:59.009145 16219 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:34:59.012581 16237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:59.013888 16219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:34:59.014077 16219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "b25d4ec32b204239b863eb6cfc62c679"
format_stamp: "Formatted at 2026-08-10 18:34:58 on dist-test-slave-5k54"
server_key: "560530efc8a4c636197f3b1fc1e09fa4"
server_key_iv: "ad65877a0089188b92ab5e9e9439e9f2"
server_key_version: "encryptionkey@0"
I20260810 18:34:59.014273 16219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:34:59.046931 16219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:34:59.051503 16219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:34:59.051836 16219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:34:59.054549 16219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:34:59.054672 16219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:59.054790 16219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:34:59.054876 16219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:34:59.058362 16063 heartbeater.cc:503] Master 127.13.139.62:35221 was elected leader, sending a full tablet report...
Aug 10 18:34:59 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386898, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:59.080575 16248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.055228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:36953 (local address 127.13.139.62:35221)
0810 18:34:59.055711 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.055719 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.056903 (+ 1184us) server_negotiation.cc:407] Connection header received
0810 18:34:59.059398 (+ 2495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.059404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.059518 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.059625 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:59.062162 (+ 2537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.063230 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.066429 (+ 3199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.067091 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.067256 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.072384 (+ 5128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:59.072389 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:59.072392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:59.072442 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:59.076811 (+ 4369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.077562 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.077571 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.077577 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.077788 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.078263 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.078270 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.078276 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.078770 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:59.078961 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.079672 (+ 711us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.079966 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":246,"threads_started":1}
I20260810 18:34:59.081360 16249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.055967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35221 (local address 127.13.139.3:36953)
0810 18:34:59.056752 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.056787 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.059001 (+ 2214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.059897 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.059918 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.060816 (+ 898us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:59.061954 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.061984 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.063417 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.063453 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.066273 (+ 2820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.066290 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.067398 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.067409 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.067824 (+ 415us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.068622 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:59.068662 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:59.072074 (+ 3412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:59.076962 (+ 4888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:59.076971 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:59.077009 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:59.077418 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:59.077906 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:59.077910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:59.077912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:59.078136 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:59.078898 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:59.078903 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:59.079238 (+ 335us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.079541 (+ 303us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.080052 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":325,"threads_started":1}
I20260810 18:34:59.103713 16248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.088629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:49477 (local address 127.13.139.62:35221)
0810 18:34:59.088813 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.088817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.089724 (+ 907us) server_negotiation.cc:407] Connection header received
0810 18:34:59.089927 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.089931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.089990 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.090086 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:59.091619 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.092530 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.095256 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.095708 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.095869 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.097598 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:59.097603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:59.097606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:59.097635 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:59.100503 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.101429 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.101435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.101438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.101630 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.102124 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.102131 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.102137 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.102546 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:59.102709 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.103099 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.103323 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 18:34:59.103893 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.088769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35221 (local address 127.13.139.3:49477)
0810 18:34:59.089600 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.089625 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.089800 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.090120 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.090125 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.090874 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:59.091467 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.091482 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.092729 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.092741 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.095099 (+ 2358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.095120 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.095919 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.095925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.096089 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.096678 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:59.096695 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:59.097404 (+ 709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:59.100621 (+ 3217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:59.100632 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:59.100636 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:59.101273 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:59.101793 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:59.101801 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:59.101805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:59.102006 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:59.102655 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:59.102660 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:59.102858 (+ 198us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.102995 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.103347 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":445,"threads_started":1}
I20260810 18:34:59.114405 16219 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:46305
I20260810 18:34:59.114470 16373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:46305 every 8 connection(s)
I20260810 18:34:59.116029 16219 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:34:59.118070 16375 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35221
I20260810 18:34:59.118333 16375 heartbeater.cc:464] Registering TS with master...
I20260810 18:34:59.118546 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 16219
I20260810 18:34:59.118716 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:34:59.119084 16375 heartbeater.cc:511] Master 127.13.139.62:35221 requested a full tablet report, sending...
I20260810 18:34:59.119215 13868 external_mini_cluster.cc:1428] Setting key 7c2f1ac5e28eec1c33551135ebcab58e
I20260810 18:34:59.120656 15827 ts_manager.cc:194] Registered new tserver with Master: b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:34:59.121507 15827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:36953
I20260810 18:34:59.123816 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 18:34:59 dist-test-slave-5k54 krb5kdc[15780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 18:34:59 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:59.176856 16248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.160544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50268 (local address 127.13.139.62:35221)
0810 18:34:59.160782 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.160789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.160995 (+ 206us) server_negotiation.cc:407] Connection header received
0810 18:34:59.161163 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.161167 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.161257 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.161347 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:59.162650 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.163353 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.165339 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.166090 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.166235 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.171376 (+ 5141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:59.171384 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:59.171391 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:59.171436 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:59.174673 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.175269 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.175273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.175275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.175403 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.175772 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.175775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.175777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.176050 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:59.176237 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.176432 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.176612 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260810 18:34:59.180887 15827 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:34:59.188077 15827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:34:59.213033 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.199658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:46305 (local address 127.0.0.1:34222)
0810 18:34:59.201144 (+ 1486us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.201175 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.201363 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.202137 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.202148 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.202183 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:59.202608 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.202634 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.205613 (+ 2979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.205622 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.209012 (+ 3390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.209043 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.211675 (+ 2632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.211685 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.212035 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.212116 (+ 81us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.212249 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.212509 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1218,"thread_start_us":2428,"threads_started":1}
I20260810 18:34:59.213119 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.200604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49336 (local address 127.13.139.1:34677)
0810 18:34:59.201944 (+ 1340us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.201954 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.202560 (+ 606us) server_negotiation.cc:407] Connection header received
0810 18:34:59.202864 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.202873 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.203112 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.203277 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:59.204285 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.206264 (+ 1979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.209456 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.211327 (+ 1871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.211456 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.211680 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.212449 (+ 769us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.212691 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1187,"thread_start_us":1041,"threads_started":1}
I20260810 18:34:59.214111 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.200303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34677 (local address 127.0.0.1:49336)
0810 18:34:59.202437 (+ 2134us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.202456 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.202677 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.203558 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.203563 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.203586 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:59.204087 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.204100 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.206518 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.206526 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.209228 (+ 2702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.209248 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.211881 (+ 2633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.211890 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.212175 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.212229 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.213446 (+ 1217us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.213652 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1976,"thread_start_us":630,"threads_started":1}
I20260810 18:34:59.214612 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.199962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34222 (local address 127.13.139.3:46305)
0810 18:34:59.200771 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.200783 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.201282 (+ 499us) server_negotiation.cc:407] Connection header received
0810 18:34:59.201577 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.201586 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.201870 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.202092 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:59.202907 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.205411 (+ 2504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.209322 (+ 3911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.211367 (+ 2045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.213583 (+ 2216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.213914 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.213998 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.214219 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":442,"threads_started":1}
I20260810 18:34:59.218644 15985 tablet_service.cc:1467] Processing CreateTablet for tablet 49c899ea550c48648abdfed918825095 (DEFAULT_TABLE table=test-table [id=ce12da8eaafc448d90ab3b5d84134935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:59.218961 16292 tablet_service.cc:1467] Processing CreateTablet for tablet 49c899ea550c48648abdfed918825095 (DEFAULT_TABLE table=test-table [id=ce12da8eaafc448d90ab3b5d84134935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:59.220252 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c899ea550c48648abdfed918825095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.220252 15985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c899ea550c48648abdfed918825095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.221901 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.202533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:45423 (local address 127.0.0.1:58664)
0810 18:34:59.213307 (+ 10774us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.213325 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.213414 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.216946 (+ 3532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.216952 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.216988 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:59.217174 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.217185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.218535 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.218540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.219909 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.219921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.221137 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.221143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.221323 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.221364 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.221469 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.221621 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10657,"thread_start_us":12423,"threads_started":1}
I20260810 18:34:59.222747 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.202785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.13.139.2:45423)
0810 18:34:59.216269 (+ 13484us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.216278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.216307 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:34:59.216400 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.216408 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.216765 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.217009 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:59.217343 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.218319 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.220057 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.220972 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.221127 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.221329 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.221510 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.222453 (+ 943us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12707,"thread_start_us":12547,"threads_started":1}
I20260810 18:34:59.225306 16139 tablet_service.cc:1467] Processing CreateTablet for tablet 49c899ea550c48648abdfed918825095 (DEFAULT_TABLE table=test-table [id=ce12da8eaafc448d90ab3b5d84134935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:59.226404 16139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c899ea550c48648abdfed918825095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.235311 16399 tablet_bootstrap.cc:492] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Bootstrap starting.
I20260810 18:34:59.236085 16398 tablet_bootstrap.cc:492] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Bootstrap starting.
I20260810 18:34:59.239023 16400 tablet_bootstrap.cc:492] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Bootstrap starting.
I20260810 18:34:59.240306 16399 tablet_bootstrap.cc:654] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.240334 16398 tablet_bootstrap.cc:654] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.241335 16398 log.cc:824] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:59.241593 16399 log.cc:824] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:59.242468 16400 tablet_bootstrap.cc:654] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.243639 16400 log.cc:824] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Log is configured to *not* fsync() on all Append() calls
I20260810 18:34:59.244743 16399 tablet_bootstrap.cc:492] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: No bootstrap required, opened a new log
I20260810 18:34:59.244835 16398 tablet_bootstrap.cc:492] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: No bootstrap required, opened a new log
I20260810 18:34:59.245055 16399 ts_tablet_manager.cc:1397] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260810 18:34:59.245054 16398 ts_tablet_manager.cc:1397] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260810 18:34:59.246086 16400 tablet_bootstrap.cc:492] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: No bootstrap required, opened a new log
I20260810 18:34:59.246338 16400 ts_tablet_manager.cc:1397] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 18:34:59.254073 16400 raft_consensus.cc:348] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.254480 16400 raft_consensus.cc:374] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.254592 16400 raft_consensus.cc:729] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16c4566888d34b76bbda03de3118c611, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.255231 16400 consensus_queue.cc:260] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.255929 16398 raft_consensus.cc:348] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.255935 16399 raft_consensus.cc:348] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.256346 16215 heartbeater.cc:503] Master 127.13.139.62:35221 was elected leader, sending a full tablet report...
I20260810 18:34:59.256347 16398 raft_consensus.cc:374] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.256348 16399 raft_consensus.cc:374] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.256441 16399 raft_consensus.cc:729] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25d4ec32b204239b863eb6cfc62c679, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.256445 16398 raft_consensus.cc:729] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.257025 16398 consensus_queue.cc:260] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.257067 16399 consensus_queue.cc:260] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.257345 16400 ts_tablet_manager.cc:1428] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Time spent starting tablet: real 0.011s user 0.009s sys 0.004s
I20260810 18:34:59.259253 16398 ts_tablet_manager.cc:1428] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260810 18:34:59.259253 16399 ts_tablet_manager.cc:1428] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260810 18:34:59.259909 16375 heartbeater.cc:503] Master 127.13.139.62:35221 was elected leader, sending a full tablet report...
I20260810 18:34:59.265357 16404 raft_consensus.cc:482] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:34:59.265630 16404 raft_consensus.cc:504] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.267277 16404 leader_election.cc:288] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305), c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677)
I20260810 18:34:59.274400 16408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.267557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:46305 (local address 127.13.139.2:53745)
0810 18:34:59.268349 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.268369 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.268512 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.268880 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.268883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.268901 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:59.269217 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.269225 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.270946 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.270949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.272478 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.272492 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.273760 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.273766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.273977 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.274003 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.274070 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.274154 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":5132,"threads_started":1}
I20260810 18:34:59.274518 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.267543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:53745 (local address 127.13.139.3:46305)
0810 18:34:59.267730 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.267734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.268473 (+ 739us) server_negotiation.cc:407] Connection header received
0810 18:34:59.268644 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.268652 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.268753 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.268875 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:59.269348 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.270814 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.272634 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.273506 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.273641 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.273694 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.274125 (+ 431us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.274266 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 18:34:59.275592 16322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c899ea550c48648abdfed918825095" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679" is_pre_election: true
I20260810 18:34:59.276119 16322 raft_consensus.cc:2454] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 0.
I20260810 18:34:59.276759 16088 leader_election.cc:302] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c4566888d34b76bbda03de3118c611, b25d4ec32b204239b863eb6cfc62c679; no voters:
I20260810 18:34:59.277208 16404 raft_consensus.cc:2781] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:34:59.277364 16404 raft_consensus.cc:482] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:34:59.277460 16404 raft_consensus.cc:3037] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.280084 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.268196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:44907 (local address 127.13.139.1:34677)
0810 18:34:59.268376 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.268383 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.273012 (+ 4629us) server_negotiation.cc:407] Connection header received
0810 18:34:59.273188 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.273192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.273265 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.273358 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:59.273958 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.276207 (+ 2249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.278405 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.279148 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.279267 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.279315 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.279714 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.279840 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:34:59.280149 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.267603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34677 (local address 127.13.139.2:44907)
0810 18:34:59.272912 (+ 5309us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.272926 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.273066 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.273372 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.273376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.273400 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:59.273795 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.273805 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.276343 (+ 2538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.276349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.278255 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.278269 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.279368 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.279375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.279555 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.279585 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.279681 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.279813 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5218,"thread_start_us":485,"threads_started":1}
I20260810 18:34:59.280686 16404 raft_consensus.cc:504] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.281104 16009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c899ea550c48648abdfed918825095" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c887ee0c072d4bb4b879027275a8e51c" is_pre_election: true
I20260810 18:34:59.281375 16404 leader_election.cc:288] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 election: Requested vote from peers b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305), c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677)
I20260810 18:34:59.281627 16009 raft_consensus.cc:2454] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 0.
I20260810 18:34:59.281739 16322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c899ea550c48648abdfed918825095" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679"
I20260810 18:34:59.281922 16322 raft_consensus.cc:3037] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.281934 16008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c899ea550c48648abdfed918825095" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c887ee0c072d4bb4b879027275a8e51c"
I20260810 18:34:59.282232 16008 raft_consensus.cc:3037] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.284608 16008 raft_consensus.cc:2454] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 1.
I20260810 18:34:59.284600 16322 raft_consensus.cc:2454] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 1.
I20260810 18:34:59.284976 16088 leader_election.cc:302] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c4566888d34b76bbda03de3118c611, b25d4ec32b204239b863eb6cfc62c679; no voters:
I20260810 18:34:59.285247 16404 raft_consensus.cc:2781] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:59.285703 16404 raft_consensus.cc:686] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 1 LEADER]: Becoming Leader. State: Replica: 16c4566888d34b76bbda03de3118c611, State: Running, Role: LEADER
I20260810 18:34:59.286203 16404 consensus_queue.cc:237] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } }
I20260810 18:34:59.290949 15827 catalog_manager.cc:5495] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16c4566888d34b76bbda03de3118c611 (127.13.139.2). New cstate: current_term: 1 leader_uuid: "16c4566888d34b76bbda03de3118c611" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } health_report { overall_health: UNKNOWN } } }
W20260810 18:34:59.302218 16064 tablet.cc:2369] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:34:59.315040 16216 tablet.cc:2369] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 18:34:59 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386897, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:34:59.342638 16417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.329910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35221 (local address 127.0.0.1:50272)
0810 18:34:59.330519 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.330540 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.330697 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.330993 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.330998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.331839 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:34:59.332101 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.332113 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.333150 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.333154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.334112 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.334122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.334864 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.334873 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.335027 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.335704 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:34:59.335726 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:34:59.337789 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:34:59.340434 (+ 2645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:59.340446 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:59.340453 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:59.340831 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:59.341175 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:34:59.341181 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:34:59.341184 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:34:59.341324 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:34:59.341809 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:34:59.341817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:34:59.341990 (+ 173us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.342158 (+ 168us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.342347 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":316,"threads_started":1}
I20260810 18:34:59.342886 16248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.329869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50272 (local address 127.13.139.62:35221)
0810 18:34:59.330040 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.330045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.330619 (+ 574us) server_negotiation.cc:407] Connection header received
0810 18:34:59.330820 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.330824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.330875 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.330965 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:34:59.332244 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.333018 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.334251 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.334687 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.334804 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.337976 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:34:59.337982 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:34:59.337986 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:34:59.338016 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:34:59.340305 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.340940 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.340946 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.340953 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.341073 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:34:59.341419 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:34:59.341426 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:34:59.341430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:34:59.341691 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:34:59.341839 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.342339 (+ 500us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.342537 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:34:59.347975 15827 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:50272:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 18:34:59.348989 15827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:34:59.355921 15985 tablet_service.cc:1467] Processing CreateTablet for tablet 231d64f30c7643d2a7a31e517da92822 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7cb36b4cc6e043a3b2c7d7e04760ddf8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:34:59.356349 16292 tablet_service.cc:1467] Processing CreateTablet for tablet 231d64f30c7643d2a7a31e517da92822 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7cb36b4cc6e043a3b2c7d7e04760ddf8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:34:59.357021 15985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 231d64f30c7643d2a7a31e517da92822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.357205 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 231d64f30c7643d2a7a31e517da92822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.357479 16139 tablet_service.cc:1467] Processing CreateTablet for tablet 231d64f30c7643d2a7a31e517da92822 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7cb36b4cc6e043a3b2c7d7e04760ddf8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:34:59.358202 16139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 231d64f30c7643d2a7a31e517da92822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.363255 16400 tablet_bootstrap.cc:492] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: Bootstrap starting.
I20260810 18:34:59.364614 16398 tablet_bootstrap.cc:492] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: Bootstrap starting.
I20260810 18:34:59.364869 16399 tablet_bootstrap.cc:492] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: Bootstrap starting.
I20260810 18:34:59.365175 16400 tablet_bootstrap.cc:654] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.366257 16398 tablet_bootstrap.cc:654] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.366783 16399 tablet_bootstrap.cc:654] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: Neither blocks nor log segments found. Creating new log.
W20260810 18:34:59.367684 16376 tablet.cc:2369] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:34:59.368639 16398 tablet_bootstrap.cc:492] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: No bootstrap required, opened a new log
I20260810 18:34:59.368786 16398 ts_tablet_manager.cc:1397] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 18:34:59.369683 16398 raft_consensus.cc:348] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.369961 16398 raft_consensus.cc:374] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.370072 16398 raft_consensus.cc:729] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.370436 16399 tablet_bootstrap.cc:492] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: No bootstrap required, opened a new log
I20260810 18:34:59.370445 16400 tablet_bootstrap.cc:492] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: No bootstrap required, opened a new log
I20260810 18:34:59.370587 16400 ts_tablet_manager.cc:1397] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 18:34:59.370589 16399 ts_tablet_manager.cc:1397] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 18:34:59.370729 16398 consensus_queue.cc:260] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.371341 16400 raft_consensus.cc:348] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.371341 16399 raft_consensus.cc:348] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.371270 16406 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.371622 16400 raft_consensus.cc:374] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.371621 16399 raft_consensus.cc:374] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.371658 16406 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:59.371716 16400 raft_consensus.cc:729] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16c4566888d34b76bbda03de3118c611, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.371942 16400 consensus_queue.cc:260] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.372072 16398 ts_tablet_manager.cc:1428] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 18:34:59.372129 16399 raft_consensus.cc:729] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25d4ec32b204239b863eb6cfc62c679, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.372390 16399 consensus_queue.cc:260] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.372545 16400 ts_tablet_manager.cc:1428] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 18:34:59.372982 16399 ts_tablet_manager.cc:1428] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 18:34:59.372839 16404 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.373133 16404 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:59.373379 16405 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.373793 16405 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:59.568238 16406 raft_consensus.cc:482] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:34:59.568491 16406 raft_consensus.cc:504] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.569933 16406 leader_election.cc:288] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:34:59.577972 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.570438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:46737 (local address 127.13.139.2:45423)
0810 18:34:59.570652 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.570660 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.571143 (+ 483us) server_negotiation.cc:407] Connection header received
0810 18:34:59.571443 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.571451 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.571565 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.571664 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:59.572481 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.573448 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.576018 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.577193 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.577366 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.577439 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.577659 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.577801 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 18:34:59.578408 16421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.570346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:45423 (local address 127.13.139.1:46737)
0810 18:34:59.571038 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.571053 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.571223 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.571839 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.571844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.571870 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:59.572283 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.572292 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.573667 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.573672 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.575845 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.575860 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.577373 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.577377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.577501 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.577525 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.577627 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.577774 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":22,"thread_start_us":423,"threads_started":1}
I20260810 18:34:59.578442 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.571643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:34581 (local address 127.13.139.3:46305)
0810 18:34:59.571813 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.571819 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.571945 (+ 126us) server_negotiation.cc:407] Connection header received
0810 18:34:59.572219 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.572225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.572298 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.572394 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:34:59.572956 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.574032 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.576341 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.577526 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.577675 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.577740 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.578096 (+ 356us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.578241 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:34:59.578531 16422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.571207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:46305 (local address 127.13.139.1:34581)
0810 18:34:59.571848 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.571865 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.572064 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.572438 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.572442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.572468 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:34:59.572779 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.572791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.574175 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.574180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.576199 (+ 2019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.576208 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.577736 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.577741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.577909 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.577954 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.578045 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.578180 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":43,"thread_start_us":590,"threads_started":1}
I20260810 18:34:59.579288 16322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231d64f30c7643d2a7a31e517da92822" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679" is_pre_election: true
I20260810 18:34:59.579624 16322 raft_consensus.cc:2454] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 0.
I20260810 18:34:59.579651 16168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231d64f30c7643d2a7a31e517da92822" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c4566888d34b76bbda03de3118c611" is_pre_election: true
I20260810 18:34:59.580101 16168 raft_consensus.cc:2454] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 0.
I20260810 18:34:59.580130 15933 leader_election.cc:302] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b25d4ec32b204239b863eb6cfc62c679, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:34:59.580536 16406 raft_consensus.cc:2781] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:34:59.580698 16406 raft_consensus.cc:482] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:34:59.580812 16406 raft_consensus.cc:3037] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.582926 16406 raft_consensus.cc:504] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.583573 16406 leader_election.cc:288] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 election: Requested vote from peers 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:34:59.584081 16322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231d64f30c7643d2a7a31e517da92822" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679"
I20260810 18:34:59.584079 16168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "231d64f30c7643d2a7a31e517da92822" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c4566888d34b76bbda03de3118c611"
I20260810 18:34:59.584295 16322 raft_consensus.cc:3037] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.584295 16168 raft_consensus.cc:3037] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.587378 16322 raft_consensus.cc:2454] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 1.
I20260810 18:34:59.587396 16168 raft_consensus.cc:2454] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 1.
I20260810 18:34:59.587775 15933 leader_election.cc:302] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c4566888d34b76bbda03de3118c611, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:34:59.588063 16406 raft_consensus.cc:2781] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:59.588486 16406 raft_consensus.cc:686] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [term 1 LEADER]: Becoming Leader. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Running, Role: LEADER
I20260810 18:34:59.588951 16406 consensus_queue.cc:237] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.592133 16423 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: TxnStatusTablet state changed. Reason: New leader c887ee0c072d4bb4b879027275a8e51c. Latest consensus state: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.592535 16423 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:34:59.593247 16426 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 18:34:59.593551 16426 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 18:34:59.593657 15827 catalog_manager.cc:5495] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c reported cstate change: term changed from 0 to 1, leader changed from <none> to c887ee0c072d4bb4b879027275a8e51c (127.13.139.1). New cstate: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260810 18:34:59.613224 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.606954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49350 (local address 127.13.139.1:34677)
0810 18:34:59.607142 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.607149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.607347 (+ 198us) server_negotiation.cc:407] Connection header received
0810 18:34:59.607628 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.607632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.607710 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.607825 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:59.608218 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.609158 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.611110 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.611594 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.611685 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.612206 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.612679 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.612777 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.612924 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.612984 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 18:34:59.613371 16417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.606978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34677 (local address 127.0.0.1:49350)
0810 18:34:59.607249 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.607271 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.607444 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.607873 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.607878 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.607891 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:34:59.608093 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.608105 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.609296 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.609303 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.610975 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.610991 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.611735 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.611742 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.611966 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.612037 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.612786 (+ 749us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.612807 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.612897 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.613049 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 18:34:59.621848 16322 raft_consensus.cc:1261] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Refusing update from remote peer c887ee0c072d4bb4b879027275a8e51c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:59.621809 16168 raft_consensus.cc:1261] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Refusing update from remote peer c887ee0c072d4bb4b879027275a8e51c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:59.622817 16423 consensus_queue.cc:1035] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:59.623246 16406 consensus_queue.cc:1035] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:59.633980 16404 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: TxnStatusTablet state changed. Reason: New leader c887ee0c072d4bb4b879027275a8e51c. Latest consensus state: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.634361 16404 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:59.635129 16405 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: TxnStatusTablet state changed. Reason: New leader c887ee0c072d4bb4b879027275a8e51c. Latest consensus state: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.635403 16405 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:59.639472 16423 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.639750 16423 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:34:59.645897 16423 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.646277 16423 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P c887ee0c072d4bb4b879027275a8e51c: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:34:59.648861 16404 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.649173 16404 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P 16c4566888d34b76bbda03de3118c611: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:59.652531 16405 tablet_replica.cc:439] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } } }
I20260810 18:34:59.652782 16405 tablet_replica.cc:442] T 231d64f30c7643d2a7a31e517da92822 P b25d4ec32b204239b863eb6cfc62c679: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:34:59.657451 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.650189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58668 (local address 127.13.139.2:45423)
0810 18:34:59.650398 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.650406 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.650426 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:34:59.650515 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.650519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.650610 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.650770 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:59.651187 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.652377 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.654711 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.655280 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.655441 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.656060 (+ 619us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.656725 (+ 665us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.656870 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.657029 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.657116 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:34:59.674686 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.668691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:43807 (local address 127.13.139.1:34677)
0810 18:34:59.668950 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.668958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.669474 (+ 516us) server_negotiation.cc:407] Connection header received
0810 18:34:59.669720 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.669724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.669801 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.669904 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:59.670421 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.671224 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.672802 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.673275 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.673413 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.673880 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.673993 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.674095 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.674241 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.674323 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 18:34:59.674791 16443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.668625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34677 (local address 127.13.139.2:43807)
0810 18:34:59.669357 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.669374 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.669553 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.669918 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.669923 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.669935 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:34:59.670245 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.670254 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.671375 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.671382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.672623 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.672635 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.673481 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.673488 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.673618 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.673671 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.674099 (+ 428us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.674113 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.674214 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.674372 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":393,"threads_started":1}
I20260810 18:34:59.684279 16322 raft_consensus.cc:1261] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Refusing update from remote peer 16c4566888d34b76bbda03de3118c611: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:59.684377 16008 raft_consensus.cc:1261] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Refusing update from remote peer 16c4566888d34b76bbda03de3118c611: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:59.684922 16404 consensus_queue.cc:1035] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:59.685246 16409 consensus_queue.cc:1035] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:59.703315 16430 mvcc.cc:205] Tried to move back new op lower bound from 7317040741098135552 to 7317040739480190976. Current Snapshot: MvccSnapshot[applied={T|T < 7317040741098135552}]
I20260810 18:34:59.729565 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.721747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:43349 (local address 127.13.139.2:45423)
0810 18:34:59.721970 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.721978 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.722794 (+ 816us) server_negotiation.cc:407] Connection header received
0810 18:34:59.722969 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.722975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.723061 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.723154 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:59.723962 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.724856 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.726995 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.727530 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.727677 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.728211 (+ 534us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.728368 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.728491 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.729196 (+ 705us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.729286 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:34:59.729707 16451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.721834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:45423 (local address 127.13.139.1:43349)
0810 18:34:59.722681 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.722707 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.722833 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.723330 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.723336 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.723349 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:34:59.723769 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.723781 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.725001 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.725007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.726852 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.726868 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.727727 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.727733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.727911 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.727993 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.728911 (+ 918us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.728924 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.729033 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.729184 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":463,"threads_started":1}
I20260810 18:34:59.768898 15827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:34:59.769213 15827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:34:59.773278 15827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Sending DeleteTablet for 3 replicas of tablet 49c899ea550c48648abdfed918825095
I20260810 18:34:59.774573 15985 tablet_service.cc:1514] Processing DeleteTablet for tablet 49c899ea550c48648abdfed918825095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:59 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:49336
I20260810 18:34:59.774883 16292 tablet_service.cc:1514] Processing DeleteTablet for tablet 49c899ea550c48648abdfed918825095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:59 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:34222
I20260810 18:34:59.775816 16139 tablet_service.cc:1514] Processing DeleteTablet for tablet 49c899ea550c48648abdfed918825095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:34:59 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58664
I20260810 18:34:59.778331 15827 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:34:59.778996 15827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:34:59.779932 16455 tablet_replica.cc:330] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: stopping tablet replica
I20260810 18:34:59.780488 16455 raft_consensus.cc:2229] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:34:59.780973 16455 raft_consensus.cc:2258] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:59.786597 15984 tablet_service.cc:1467] Processing CreateTablet for tablet b578ea261ce04c04b5ea387b07c84c5f (DEFAULT_TABLE table=test-table [id=dc91142dc51f48c58a43084dfa9941aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:59.787154 16456 tablet_replica.cc:330] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: stopping tablet replica
I20260810 18:34:59.787184 15984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b578ea261ce04c04b5ea387b07c84c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.787726 16456 raft_consensus.cc:2229] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:34:59.787892 16455 ts_tablet_manager.cc:1905] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:59.788516 16456 raft_consensus.cc:2258] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:59.790460 16456 ts_tablet_manager.cc:1905] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:59.791109 16454 tablet_replica.cc:330] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: stopping tablet replica
I20260810 18:34:59.792593 16292 tablet_service.cc:1467] Processing CreateTablet for tablet b578ea261ce04c04b5ea387b07c84c5f (DEFAULT_TABLE table=test-table [id=dc91142dc51f48c58a43084dfa9941aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:59.792829 16139 tablet_service.cc:1467] Processing CreateTablet for tablet b578ea261ce04c04b5ea387b07c84c5f (DEFAULT_TABLE table=test-table [id=dc91142dc51f48c58a43084dfa9941aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:34:59.793115 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b578ea261ce04c04b5ea387b07c84c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.793246 16139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b578ea261ce04c04b5ea387b07c84c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:34:59.800115 16399 tablet_bootstrap.cc:492] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: Bootstrap starting.
I20260810 18:34:59.801923 16399 tablet_bootstrap.cc:654] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.804049 16400 tablet_bootstrap.cc:492] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: Bootstrap starting.
I20260810 18:34:59.805749 16400 tablet_bootstrap.cc:654] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.807410 16455 ts_tablet_manager.cc:1918] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:34:59.807667 16455 log.cc:1196] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/49c899ea550c48648abdfed918825095
I20260810 18:34:59.808394 16455 ts_tablet_manager.cc:1939] T 49c899ea550c48648abdfed918825095 P b25d4ec32b204239b863eb6cfc62c679: Deleting consensus metadata
I20260810 18:34:59.810809 15815 catalog_manager.cc:4841] TS b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305): tablet 49c899ea550c48648abdfed918825095 (table test-table [id=ce12da8eaafc448d90ab3b5d84134935]) successfully deleted
I20260810 18:34:59.803220 16398 tablet_bootstrap.cc:492] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: Bootstrap starting.
I20260810 18:34:59.812879 16398 tablet_bootstrap.cc:654] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: Neither blocks nor log segments found. Creating new log.
I20260810 18:34:59.812885 16400 tablet_bootstrap.cc:492] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: No bootstrap required, opened a new log
I20260810 18:34:59.813073 16400 ts_tablet_manager.cc:1397] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 18:34:59.813908 16400 raft_consensus.cc:348] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.814191 16400 raft_consensus.cc:374] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.814270 16400 raft_consensus.cc:729] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16c4566888d34b76bbda03de3118c611, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.814569 16400 consensus_queue.cc:260] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.816989 16400 ts_tablet_manager.cc:1428] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260810 18:34:59.820436 16454 raft_consensus.cc:2229] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:34:59.820798 16454 raft_consensus.cc:2258] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:34:59.821803 16398 tablet_bootstrap.cc:492] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: No bootstrap required, opened a new log
I20260810 18:34:59.822009 16398 ts_tablet_manager.cc:1397] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260810 18:34:59.822805 16398 raft_consensus.cc:348] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.823092 16398 raft_consensus.cc:374] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.823181 16398 raft_consensus.cc:729] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.823514 16398 consensus_queue.cc:260] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.824261 16398 ts_tablet_manager.cc:1428] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 18:34:59.826258 16454 ts_tablet_manager.cc:1905] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:34:59.829376 16399 tablet_bootstrap.cc:492] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: No bootstrap required, opened a new log
I20260810 18:34:59.829643 16399 ts_tablet_manager.cc:1397] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.008s
I20260810 18:34:59.831982 16399 raft_consensus.cc:348] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.832444 16399 raft_consensus.cc:374] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:34:59.832593 16399 raft_consensus.cc:729] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25d4ec32b204239b863eb6cfc62c679, State: Initialized, Role: FOLLOWER
I20260810 18:34:59.832969 16399 consensus_queue.cc:260] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.834306 16454 ts_tablet_manager.cc:1918] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:34:59.834482 16454 log.cc:1196] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/49c899ea550c48648abdfed918825095
I20260810 18:34:59.835059 16454 ts_tablet_manager.cc:1939] T 49c899ea550c48648abdfed918825095 P c887ee0c072d4bb4b879027275a8e51c: Deleting consensus metadata
I20260810 18:34:59.836859 15812 catalog_manager.cc:4841] TS c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677): tablet 49c899ea550c48648abdfed918825095 (table test-table [id=ce12da8eaafc448d90ab3b5d84134935]) successfully deleted
I20260810 18:34:59.837491 16399 ts_tablet_manager.cc:1428] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260810 18:34:59.842512 16456 ts_tablet_manager.cc:1918] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:34:59.842725 16456 log.cc:1196] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/49c899ea550c48648abdfed918825095
I20260810 18:34:59.843461 16456 ts_tablet_manager.cc:1939] T 49c899ea550c48648abdfed918825095 P 16c4566888d34b76bbda03de3118c611: Deleting consensus metadata
I20260810 18:34:59.845455 15815 catalog_manager.cc:4841] TS 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423): tablet 49c899ea550c48648abdfed918825095 (table test-table [id=ce12da8eaafc448d90ab3b5d84134935]) successfully deleted
I20260810 18:34:59.885996 16406 raft_consensus.cc:482] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:34:59.886234 16406 raft_consensus.cc:504] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.887212 16406 leader_election.cc:288] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:34:59.887873 16322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b578ea261ce04c04b5ea387b07c84c5f" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679" is_pre_election: true
I20260810 18:34:59.887933 16168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b578ea261ce04c04b5ea387b07c84c5f" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c4566888d34b76bbda03de3118c611" is_pre_election: true
I20260810 18:34:59.888126 16322 raft_consensus.cc:2454] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 0.
I20260810 18:34:59.888229 16168 raft_consensus.cc:2454] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 0.
I20260810 18:34:59.888662 15933 leader_election.cc:302] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b25d4ec32b204239b863eb6cfc62c679, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:34:59.888971 16406 raft_consensus.cc:2781] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:34:59.889122 16406 raft_consensus.cc:482] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:34:59.889228 16406 raft_consensus.cc:3037] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.893321 16406 raft_consensus.cc:504] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.893991 16406 leader_election.cc:288] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 election: Requested vote from peers 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:34:59.894529 16322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b578ea261ce04c04b5ea387b07c84c5f" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679"
I20260810 18:34:59.894639 16168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b578ea261ce04c04b5ea387b07c84c5f" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c4566888d34b76bbda03de3118c611"
I20260810 18:34:59.894737 16322 raft_consensus.cc:3037] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.894884 16168 raft_consensus.cc:3037] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:34:59.897783 16322 raft_consensus.cc:2454] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 1.
I20260810 18:34:59.898331 15933 leader_election.cc:302] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b25d4ec32b204239b863eb6cfc62c679, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:34:59.898948 16168 raft_consensus.cc:2454] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 1.
I20260810 18:34:59.899156 16406 raft_consensus.cc:2781] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:34:59.899770 16406 raft_consensus.cc:686] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 1 LEADER]: Becoming Leader. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Running, Role: LEADER
I20260810 18:34:59.900092 16406 consensus_queue.cc:237] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:34:59.905535 15828 catalog_manager.cc:5495] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c reported cstate change: term changed from 0 to 1, leader changed from <none> to c887ee0c072d4bb4b879027275a8e51c (127.13.139.1). New cstate: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260810 18:34:59.936136 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.928171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49366 (local address 127.13.139.1:34677)
0810 18:34:59.928361 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.928367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.928853 (+ 486us) server_negotiation.cc:407] Connection header received
0810 18:34:59.928939 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.928944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.929029 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.929106 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:59.930069 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.931397 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.933505 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.934262 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.934403 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.935004 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.935135 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.935250 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.935711 (+ 461us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.935799 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 18:34:59.952354 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.945698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:56249 (local address 127.13.139.1:34677)
0810 18:34:59.945879 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 18:34:59.945885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:34:59.946109 (+ 224us) server_negotiation.cc:407] Connection header received
0810 18:34:59.946274 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:34:59.946280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:34:59.946367 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:34:59.946466 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:34:59.946850 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.948133 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.950245 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.950958 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.951093 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.951583 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.951721 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.951819 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 18:34:59.951971 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 18:34:59.952063 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:34:59.952422 16451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:34:59.945772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34677 (local address 127.13.139.1:56249)
0810 18:34:59.946013 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 18:34:59.946031 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:34:59.946152 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:34:59.946494 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:34:59.946501 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:34:59.946516 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:34:59.946712 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.946724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.948287 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.948293 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.950093 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:34:59.950110 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:34:59.951144 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:34:59.951150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:34:59.951371 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:34:59.951439 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:34:59.951835 (+ 396us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:34:59.951849 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 18:34:59.951949 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 18:34:59.952109 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":1}
I20260810 18:34:59.962837 16322 raft_consensus.cc:1261] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Refusing update from remote peer c887ee0c072d4bb4b879027275a8e51c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:59.962867 16168 raft_consensus.cc:1261] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Refusing update from remote peer c887ee0c072d4bb4b879027275a8e51c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:34:59.963601 16406 consensus_queue.cc:1035] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:59.964073 16406 consensus_queue.cc:1035] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:34:59.991230 16431 mvcc.cc:205] Tried to move back new op lower bound from 7317040742242152448 to 7317040741993771008. Current Snapshot: MvccSnapshot[applied={T|T < 7317040742242152448}]
W20260810 18:34:59.997602 16429 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 18:35:01.623111 15827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:01.623359 15827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:01.627619 15827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Sending DeleteTablet for 3 replicas of tablet b578ea261ce04c04b5ea387b07c84c5f
I20260810 18:35:01.628468 15985 tablet_service.cc:1514] Processing DeleteTablet for tablet b578ea261ce04c04b5ea387b07c84c5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:01 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:49336
I20260810 18:35:01.628769 16292 tablet_service.cc:1514] Processing DeleteTablet for tablet b578ea261ce04c04b5ea387b07c84c5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:01 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:34222
I20260810 18:35:01.628947 16139 tablet_service.cc:1514] Processing DeleteTablet for tablet b578ea261ce04c04b5ea387b07c84c5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:01 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58664
I20260810 18:35:01.642365 16490 tablet_replica.cc:330] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: stopping tablet replica
I20260810 18:35:01.642889 16490 raft_consensus.cc:2229] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:01.643342 16490 raft_consensus.cc:2258] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:01.643806 16489 tablet_replica.cc:330] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: stopping tablet replica
I20260810 18:35:01.644172 16489 raft_consensus.cc:2229] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:01.644668 16490 ts_tablet_manager.cc:1905] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:01.644903 16489 raft_consensus.cc:2258] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:01.646353 16489 ts_tablet_manager.cc:1905] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:01.652120 16491 tablet_replica.cc:330] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: stopping tablet replica
I20260810 18:35:01.652351 16491 raft_consensus.cc:2229] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:01.652756 16491 raft_consensus.cc:2258] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:01.653082 16490 ts_tablet_manager.cc:1918] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 18:35:01.653228 16490 log.cc:1196] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/b578ea261ce04c04b5ea387b07c84c5f
I20260810 18:35:01.653770 16490 ts_tablet_manager.cc:1939] T b578ea261ce04c04b5ea387b07c84c5f P b25d4ec32b204239b863eb6cfc62c679: Deleting consensus metadata
I20260810 18:35:01.653945 16491 ts_tablet_manager.cc:1905] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:01.654461 16489 ts_tablet_manager.cc:1918] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 18:35:01.654683 16489 log.cc:1196] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/b578ea261ce04c04b5ea387b07c84c5f
I20260810 18:35:01.655121 15815 catalog_manager.cc:4841] TS b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305): tablet b578ea261ce04c04b5ea387b07c84c5f (table test-table [id=dc91142dc51f48c58a43084dfa9941aa]) successfully deleted
I20260810 18:35:01.655298 16489 ts_tablet_manager.cc:1939] T b578ea261ce04c04b5ea387b07c84c5f P c887ee0c072d4bb4b879027275a8e51c: Deleting consensus metadata
I20260810 18:35:01.656514 15812 catalog_manager.cc:4841] TS c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677): tablet b578ea261ce04c04b5ea387b07c84c5f (table test-table [id=dc91142dc51f48c58a43084dfa9941aa]) successfully deleted
I20260810 18:35:01.660624 16491 ts_tablet_manager.cc:1918] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 18:35:01.660909 16491 log.cc:1196] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/b578ea261ce04c04b5ea387b07c84c5f
I20260810 18:35:01.661345 16491 ts_tablet_manager.cc:1939] T b578ea261ce04c04b5ea387b07c84c5f P 16c4566888d34b76bbda03de3118c611: Deleting consensus metadata
I20260810 18:35:01.662335 15815 catalog_manager.cc:4841] TS 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423): tablet b578ea261ce04c04b5ea387b07c84c5f (table test-table [id=dc91142dc51f48c58a43084dfa9941aa]) successfully deleted
Aug 10 18:35:01 dist-test-slave-5k54 krb5kdc[15780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386901, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 18:35:01 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386901, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:01.696547 16500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:01.682857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.13.139.62:35221)
0810 18:35:01.683489 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:01.683494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:01.683611 (+ 117us) server_negotiation.cc:407] Connection header received
0810 18:35:01.683767 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:01.683772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:01.683837 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:01.683960 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:01.685308 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:01.686090 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:01.687378 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:01.687867 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:01.687988 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:01.691682 (+ 3694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:01.691687 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:01.691690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:01.691723 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:01.694270 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:01.694881 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:01.694884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:01.694887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:01.695006 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:01.695321 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:01.695324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:01.695326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:01.695668 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:01.695890 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:01.696116 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 18:35:01.696282 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":276,"threads_started":1}
I20260810 18:35:01.700193 15827 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:01.700875 15827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:01.707473 15985 tablet_service.cc:1467] Processing CreateTablet for tablet 12f4d54337cf47c9896c3798fd449368 (DEFAULT_TABLE table=test-table [id=4faf76112ece4b288faf73b2df63acf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:01.707686 16139 tablet_service.cc:1467] Processing CreateTablet for tablet 12f4d54337cf47c9896c3798fd449368 (DEFAULT_TABLE table=test-table [id=4faf76112ece4b288faf73b2df63acf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:01.707765 16292 tablet_service.cc:1467] Processing CreateTablet for tablet 12f4d54337cf47c9896c3798fd449368 (DEFAULT_TABLE table=test-table [id=4faf76112ece4b288faf73b2df63acf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:01.708002 15985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12f4d54337cf47c9896c3798fd449368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:01.708098 16139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12f4d54337cf47c9896c3798fd449368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:01.708240 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12f4d54337cf47c9896c3798fd449368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:01.713099 16501 tablet_bootstrap.cc:492] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: Bootstrap starting.
I20260810 18:35:01.714917 16502 tablet_bootstrap.cc:492] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: Bootstrap starting.
I20260810 18:35:01.715005 16501 tablet_bootstrap.cc:654] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:01.715546 16503 tablet_bootstrap.cc:492] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: Bootstrap starting.
I20260810 18:35:01.717425 16501 tablet_bootstrap.cc:492] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: No bootstrap required, opened a new log
I20260810 18:35:01.717676 16501 ts_tablet_manager.cc:1397] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 18:35:01.717839 16503 tablet_bootstrap.cc:654] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:01.718252 16502 tablet_bootstrap.cc:654] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:01.718430 16501 raft_consensus.cc:348] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.719051 16501 raft_consensus.cc:374] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:01.719214 16501 raft_consensus.cc:729] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25d4ec32b204239b863eb6cfc62c679, State: Initialized, Role: FOLLOWER
I20260810 18:35:01.719621 16501 consensus_queue.cc:260] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.720579 16501 ts_tablet_manager.cc:1428] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:01.720875 16503 tablet_bootstrap.cc:492] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: No bootstrap required, opened a new log
I20260810 18:35:01.721033 16503 ts_tablet_manager.cc:1397] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260810 18:35:01.721634 16503 raft_consensus.cc:348] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.721863 16503 raft_consensus.cc:374] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:01.721982 16503 raft_consensus.cc:729] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16c4566888d34b76bbda03de3118c611, State: Initialized, Role: FOLLOWER
I20260810 18:35:01.722244 16503 consensus_queue.cc:260] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.723073 16503 ts_tablet_manager.cc:1428] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 18:35:01.724267 16502 tablet_bootstrap.cc:492] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: No bootstrap required, opened a new log
I20260810 18:35:01.724449 16502 ts_tablet_manager.cc:1397] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.002s
I20260810 18:35:01.725046 16502 raft_consensus.cc:348] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.725204 16502 raft_consensus.cc:374] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:01.725276 16502 raft_consensus.cc:729] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Initialized, Role: FOLLOWER
I20260810 18:35:01.725481 16502 consensus_queue.cc:260] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.726038 16502 ts_tablet_manager.cc:1428] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 18:35:01.918326 16476 raft_consensus.cc:482] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:01.918594 16476 raft_consensus.cc:504] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.919505 16476 leader_election.cc:288] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:35:01.920082 16167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f4d54337cf47c9896c3798fd449368" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c4566888d34b76bbda03de3118c611" is_pre_election: true
I20260810 18:35:01.920115 16321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f4d54337cf47c9896c3798fd449368" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679" is_pre_election: true
I20260810 18:35:01.920339 16167 raft_consensus.cc:2454] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 0.
I20260810 18:35:01.920373 16321 raft_consensus.cc:2454] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 0.
I20260810 18:35:01.920933 15933 leader_election.cc:302] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c4566888d34b76bbda03de3118c611, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:35:01.921236 16476 raft_consensus.cc:2781] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:01.921346 16476 raft_consensus.cc:482] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:01.921487 16476 raft_consensus.cc:3037] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:01.923687 16476 raft_consensus.cc:504] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.924182 16476 leader_election.cc:288] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 election: Requested vote from peers 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:35:01.924710 16167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f4d54337cf47c9896c3798fd449368" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c4566888d34b76bbda03de3118c611"
I20260810 18:35:01.924916 16167 raft_consensus.cc:3037] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:01.924953 16321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12f4d54337cf47c9896c3798fd449368" candidate_uuid: "c887ee0c072d4bb4b879027275a8e51c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679"
I20260810 18:35:01.925237 16321 raft_consensus.cc:3037] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:01.927217 16167 raft_consensus.cc:2454] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 1.
I20260810 18:35:01.927634 15933 leader_election.cc:302] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c4566888d34b76bbda03de3118c611, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:35:01.927613 16321 raft_consensus.cc:2454] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c887ee0c072d4bb4b879027275a8e51c in term 1.
I20260810 18:35:01.927920 16476 raft_consensus.cc:2781] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:01.928093 16476 raft_consensus.cc:686] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 1 LEADER]: Becoming Leader. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Running, Role: LEADER
I20260810 18:35:01.928377 16476 consensus_queue.cc:237] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:01.931001 15827 catalog_manager.cc:5495] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c reported cstate change: term changed from 0 to 1, leader changed from <none> to c887ee0c072d4bb4b879027275a8e51c (127.13.139.1). New cstate: current_term: 1 leader_uuid: "c887ee0c072d4bb4b879027275a8e51c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260810 18:35:01.968883 16512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:01.963580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49374 (local address 127.13.139.1:34677)
0810 18:35:01.964160 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:01.964165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:01.964185 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:35:01.964236 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:01.964239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:01.964300 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:01.964388 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:01.964859 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:01.965716 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:01.967044 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:01.967553 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:01.967647 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:01.968033 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:01.968146 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:01.968222 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:01.968434 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 18:35:01.968492 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":366,"threads_started":1}
I20260810 18:35:01.978876 16321 raft_consensus.cc:1261] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Refusing update from remote peer c887ee0c072d4bb4b879027275a8e51c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:01.979005 16167 raft_consensus.cc:1261] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Refusing update from remote peer c887ee0c072d4bb4b879027275a8e51c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:01.979553 16464 consensus_queue.cc:1035] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:01.979871 16476 consensus_queue.cc:1035] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:01.984264 16466 mvcc.cc:205] Tried to move back new op lower bound from 7317040750500749312 to 7317040750300741632. Current Snapshot: MvccSnapshot[applied={T|T < 7317040750500749312}]
I20260810 18:35:02.022430 15827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:02.022655 15827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:02.025396 15827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Sending DeleteTablet for 3 replicas of tablet 12f4d54337cf47c9896c3798fd449368
I20260810 18:35:02.026079 15985 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f4d54337cf47c9896c3798fd449368 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:02 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:49336
I20260810 18:35:02.026295 16139 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f4d54337cf47c9896c3798fd449368 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:02 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58664
I20260810 18:35:02.026353 16292 tablet_service.cc:1514] Processing DeleteTablet for tablet 12f4d54337cf47c9896c3798fd449368 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:02 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:34222
I20260810 18:35:02.026486 16489 tablet_replica.cc:330] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: stopping tablet replica
I20260810 18:35:02.026594 16491 tablet_replica.cc:330] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: stopping tablet replica
I20260810 18:35:02.026686 16489 raft_consensus.cc:2229] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:02.026742 16491 raft_consensus.cc:2229] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:02.026870 16491 raft_consensus.cc:2258] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:02.026993 16489 raft_consensus.cc:2258] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:02.027348 16490 tablet_replica.cc:330] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: stopping tablet replica
I20260810 18:35:02.027585 16490 raft_consensus.cc:2229] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:02.027855 16490 raft_consensus.cc:2258] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:02.028141 16491 ts_tablet_manager.cc:1905] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:02.028291 16489 ts_tablet_manager.cc:1905] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:02.028349 15827 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:02.029017 15827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:02.030750 16490 ts_tablet_manager.cc:1905] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:02.035765 15985 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b251aa22e4d9abb83e86bfb4bc345 (DEFAULT_TABLE table=test-table [id=3662ee521c1b496eab60132af8d8a141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:02.035988 16491 ts_tablet_manager.cc:1918] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:02.036188 15985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b251aa22e4d9abb83e86bfb4bc345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:02.036137 16292 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b251aa22e4d9abb83e86bfb4bc345 (DEFAULT_TABLE table=test-table [id=3662ee521c1b496eab60132af8d8a141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:02.036209 16491 log.cc:1196] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/12f4d54337cf47c9896c3798fd449368
I20260810 18:35:02.036573 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b251aa22e4d9abb83e86bfb4bc345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:02.036724 16491 ts_tablet_manager.cc:1939] T 12f4d54337cf47c9896c3798fd449368 P 16c4566888d34b76bbda03de3118c611: Deleting consensus metadata
I20260810 18:35:02.038012 16490 ts_tablet_manager.cc:1918] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:02.038193 16490 log.cc:1196] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/12f4d54337cf47c9896c3798fd449368
I20260810 18:35:02.038718 16490 ts_tablet_manager.cc:1939] T 12f4d54337cf47c9896c3798fd449368 P b25d4ec32b204239b863eb6cfc62c679: Deleting consensus metadata
I20260810 18:35:02.039671 15815 catalog_manager.cc:4841] TS 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423): tablet 12f4d54337cf47c9896c3798fd449368 (table test-table [id=4faf76112ece4b288faf73b2df63acf5]) successfully deleted
I20260810 18:35:02.039904 15815 catalog_manager.cc:4841] TS b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305): tablet 12f4d54337cf47c9896c3798fd449368 (table test-table [id=4faf76112ece4b288faf73b2df63acf5]) successfully deleted
I20260810 18:35:02.040128 16139 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b251aa22e4d9abb83e86bfb4bc345 (DEFAULT_TABLE table=test-table [id=3662ee521c1b496eab60132af8d8a141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:02.040544 16139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b251aa22e4d9abb83e86bfb4bc345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:02.042703 16502 tablet_bootstrap.cc:492] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: Bootstrap starting.
I20260810 18:35:02.043246 16501 tablet_bootstrap.cc:492] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: Bootstrap starting.
I20260810 18:35:02.044446 16489 ts_tablet_manager.cc:1918] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:02.044670 16489 log.cc:1196] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/12f4d54337cf47c9896c3798fd449368
I20260810 18:35:02.044922 16501 tablet_bootstrap.cc:654] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:02.045292 16489 ts_tablet_manager.cc:1939] T 12f4d54337cf47c9896c3798fd449368 P c887ee0c072d4bb4b879027275a8e51c: Deleting consensus metadata
I20260810 18:35:02.044517 16502 tablet_bootstrap.cc:654] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:02.046411 15812 catalog_manager.cc:4841] TS c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677): tablet 12f4d54337cf47c9896c3798fd449368 (table test-table [id=4faf76112ece4b288faf73b2df63acf5]) successfully deleted
I20260810 18:35:02.047046 16503 tablet_bootstrap.cc:492] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: Bootstrap starting.
I20260810 18:35:02.048154 16501 tablet_bootstrap.cc:492] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: No bootstrap required, opened a new log
I20260810 18:35:02.048359 16501 ts_tablet_manager.cc:1397] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 18:35:02.048646 16503 tablet_bootstrap.cc:654] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:02.049647 16501 raft_consensus.cc:348] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.049898 16501 raft_consensus.cc:374] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:02.049990 16501 raft_consensus.cc:729] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25d4ec32b204239b863eb6cfc62c679, State: Initialized, Role: FOLLOWER
I20260810 18:35:02.050247 16501 consensus_queue.cc:260] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.050786 16501 ts_tablet_manager.cc:1428] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 18:35:02.051404 16502 tablet_bootstrap.cc:492] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: No bootstrap required, opened a new log
I20260810 18:35:02.052591 16502 ts_tablet_manager.cc:1397] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260810 18:35:02.053558 16502 raft_consensus.cc:348] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.053813 16502 raft_consensus.cc:374] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:02.053903 16502 raft_consensus.cc:729] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c887ee0c072d4bb4b879027275a8e51c, State: Initialized, Role: FOLLOWER
I20260810 18:35:02.054147 16502 consensus_queue.cc:260] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.054757 16502 ts_tablet_manager.cc:1428] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 18:35:02.057389 16503 tablet_bootstrap.cc:492] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: No bootstrap required, opened a new log
I20260810 18:35:02.057577 16503 ts_tablet_manager.cc:1397] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260810 18:35:02.058300 16503 raft_consensus.cc:348] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.058588 16503 raft_consensus.cc:374] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:02.058667 16503 raft_consensus.cc:729] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16c4566888d34b76bbda03de3118c611, State: Initialized, Role: FOLLOWER
I20260810 18:35:02.058984 16503 consensus_queue.cc:260] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.059615 16503 ts_tablet_manager.cc:1428] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 18:35:02.090528 16509 raft_consensus.cc:482] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:02.090775 16509 raft_consensus.cc:504] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.091667 16509 leader_election.cc:288] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:35:02.092223 16009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b251aa22e4d9abb83e86bfb4bc345" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c887ee0c072d4bb4b879027275a8e51c" is_pre_election: true
I20260810 18:35:02.092311 16321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b251aa22e4d9abb83e86bfb4bc345" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679" is_pre_election: true
I20260810 18:35:02.092463 16009 raft_consensus.cc:2454] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 0.
I20260810 18:35:02.092634 16321 raft_consensus.cc:2454] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 0.
I20260810 18:35:02.093011 16085 leader_election.cc:302] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c4566888d34b76bbda03de3118c611, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:35:02.093397 16509 raft_consensus.cc:2781] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:02.093554 16509 raft_consensus.cc:482] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:02.093673 16509 raft_consensus.cc:3037] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:02.095892 16509 raft_consensus.cc:504] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.096457 16509 leader_election.cc:288] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 election: Requested vote from peers c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677), b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305)
I20260810 18:35:02.096951 16009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b251aa22e4d9abb83e86bfb4bc345" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c887ee0c072d4bb4b879027275a8e51c"
I20260810 18:35:02.097023 16321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b251aa22e4d9abb83e86bfb4bc345" candidate_uuid: "16c4566888d34b76bbda03de3118c611" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25d4ec32b204239b863eb6cfc62c679"
I20260810 18:35:02.097157 16009 raft_consensus.cc:3037] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:02.097288 16321 raft_consensus.cc:3037] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:02.099206 16009 raft_consensus.cc:2454] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 1.
I20260810 18:35:02.099609 16085 leader_election.cc:302] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c4566888d34b76bbda03de3118c611, c887ee0c072d4bb4b879027275a8e51c; no voters:
I20260810 18:35:02.099645 16321 raft_consensus.cc:2454] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16c4566888d34b76bbda03de3118c611 in term 1.
I20260810 18:35:02.099970 16509 raft_consensus.cc:2781] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:02.100452 16509 raft_consensus.cc:686] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 1 LEADER]: Becoming Leader. State: Replica: 16c4566888d34b76bbda03de3118c611, State: Running, Role: LEADER
I20260810 18:35:02.100767 16509 consensus_queue.cc:237] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } }
I20260810 18:35:02.103461 15828 catalog_manager.cc:5495] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16c4566888d34b76bbda03de3118c611 (127.13.139.2). New cstate: current_term: 1 leader_uuid: "16c4566888d34b76bbda03de3118c611" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16c4566888d34b76bbda03de3118c611" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260810 18:35:02.141158 16525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:02.135363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58684 (local address 127.13.139.2:45423)
0810 18:35:02.136046 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:02.136052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:02.136076 (+ 24us) server_negotiation.cc:407] Connection header received
0810 18:35:02.136147 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:02.136152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:02.136227 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:02.136331 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:02.136689 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:02.137861 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:02.139328 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:02.140030 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:02.140159 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:02.140528 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:02.140648 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:02.140715 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:02.140826 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 18:35:02.140891 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":423,"threads_started":1}
I20260810 18:35:02.150123 16321 raft_consensus.cc:1261] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Refusing update from remote peer 16c4566888d34b76bbda03de3118c611: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:02.150280 16009 raft_consensus.cc:1261] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Refusing update from remote peer 16c4566888d34b76bbda03de3118c611: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:02.150789 16523 consensus_queue.cc:1035] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25d4ec32b204239b863eb6cfc62c679" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:02.151115 16509 consensus_queue.cc:1035] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c887ee0c072d4bb4b879027275a8e51c" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 18:35:02.170414 16471 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 18:35:03.750846 15827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:03.751129 15827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:03.755208 15827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a083cbf0a6648f2b5c5ff48d9b4fa72: Sending DeleteTablet for 3 replicas of tablet 2e9b251aa22e4d9abb83e86bfb4bc345
I20260810 18:35:03.756060 16139 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e9b251aa22e4d9abb83e86bfb4bc345 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:03 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58664
I20260810 18:35:03.756065 15985 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e9b251aa22e4d9abb83e86bfb4bc345 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:03 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:49336
I20260810 18:35:03.756239 16292 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e9b251aa22e4d9abb83e86bfb4bc345 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:03 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:34222
I20260810 18:35:03.757602 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15912
I20260810 18:35:03.765915 16555 tablet_replica.cc:330] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: stopping tablet replica
I20260810 18:35:03.766283 16555 raft_consensus.cc:2229] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:03.766814 16555 raft_consensus.cc:2258] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:03.767479 16554 tablet_replica.cc:330] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: stopping tablet replica
I20260810 18:35:03.767972 16553 tablet_replica.cc:330] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: stopping tablet replica
I20260810 18:35:03.768095 16555 ts_tablet_manager.cc:1905] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:03.768190 16553 raft_consensus.cc:2229] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:03.768316 16554 raft_consensus.cc:2229] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:03.768507 16553 raft_consensus.cc:2258] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:03.768771 16554 raft_consensus.cc:2258] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:03.769570 16553 ts_tablet_manager.cc:1905] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:03.770180 16554 ts_tablet_manager.cc:1905] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:03.775657 16555 ts_tablet_manager.cc:1918] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 18:35:03.775851 16555 log.cc:1196] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/2e9b251aa22e4d9abb83e86bfb4bc345
I20260810 18:35:03.776252 16553 ts_tablet_manager.cc:1918] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 18:35:03.776404 16555 ts_tablet_manager.cc:1939] T 2e9b251aa22e4d9abb83e86bfb4bc345 P b25d4ec32b204239b863eb6cfc62c679: Deleting consensus metadata
I20260810 18:35:03.776436 16553 log.cc:1196] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/2e9b251aa22e4d9abb83e86bfb4bc345
Aug 10 18:35:03 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386901, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:03.776934 16553 ts_tablet_manager.cc:1939] T 2e9b251aa22e4d9abb83e86bfb4bc345 P c887ee0c072d4bb4b879027275a8e51c: Deleting consensus metadata
I20260810 18:35:03.777101 16554 ts_tablet_manager.cc:1918] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 18:35:03.777316 16554 log.cc:1196] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/2e9b251aa22e4d9abb83e86bfb4bc345
I20260810 18:35:03.777706 15815 catalog_manager.cc:4841] TS b25d4ec32b204239b863eb6cfc62c679 (127.13.139.3:46305): tablet 2e9b251aa22e4d9abb83e86bfb4bc345 (table test-table [id=3662ee521c1b496eab60132af8d8a141]) successfully deleted
I20260810 18:35:03.777841 16554 ts_tablet_manager.cc:1939] T 2e9b251aa22e4d9abb83e86bfb4bc345 P 16c4566888d34b76bbda03de3118c611: Deleting consensus metadata
I20260810 18:35:03.777973 15812 catalog_manager.cc:4841] TS c887ee0c072d4bb4b879027275a8e51c (127.13.139.1:34677): tablet 2e9b251aa22e4d9abb83e86bfb4bc345 (table test-table [id=3662ee521c1b496eab60132af8d8a141]) successfully deleted
I20260810 18:35:03.778849 15815 catalog_manager.cc:4841] TS 16c4566888d34b76bbda03de3118c611 (127.13.139.2:45423): tablet 2e9b251aa22e4d9abb83e86bfb4bc345 (table test-table [id=3662ee521c1b496eab60132af8d8a141]) successfully deleted
I20260810 18:35:03.783741 16561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:03.760881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49386 (local address 127.13.139.1:34677)
0810 18:35:03.765462 (+ 4581us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:03.765469 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:03.766012 (+ 543us) server_negotiation.cc:407] Connection header received
0810 18:35:03.766096 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:03.766105 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:03.766208 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:03.766329 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:03.768553 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:03.769738 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:03.771594 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:03.772231 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:03.772353 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:03.778116 (+ 5763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:03.778136 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:03.778158 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:03.778210 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:03.781244 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:03.781883 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:03.781890 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:03.781892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:03.782057 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:03.782373 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:03.782376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:03.782378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:03.782709 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:03.782948 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:03.783117 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 18:35:03.783290 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4439,"thread_start_us":4285,"threads_started":1}
W20260810 18:35:03.784368 16058 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49386
W20260810 18:35:03.785032 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15912: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:35:03.785265 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 15912
I20260810 18:35:03.814656 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16069
Aug 10 18:35:03 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386901, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:35:03.829365 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:03.815441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58700 (local address 127.13.139.2:45423)
0810 18:35:03.816027 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:03.816031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:03.816047 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:35:03.816103 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:03.816107 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:03.816170 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:03.816262 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:03.817597 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:03.818344 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:03.819643 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:03.820026 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:03.820126 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:03.824190 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:03.824205 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:03.824220 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:03.824253 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:03.826992 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:03.827665 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:03.827672 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:03.827674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:03.827824 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:03.828144 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:03.828147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:03.828149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:03.828513 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:03.828714 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:03.828942 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 18:35:03.829103 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":333,"threads_started":1}
W20260810 18:35:03.830062 16210 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58700
W20260810 18:35:03.830663 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16069: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:35:03.830842 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 16069
I20260810 18:35:03.856385 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16219
Aug 10 18:35:03 dist-test-slave-5k54 krb5kdc[15780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386901, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:35:03.871531 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:03.857230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34224 (local address 127.13.139.3:46305)
0810 18:35:03.857875 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:03.857879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:03.857895 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:35:03.857956 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:03.857959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:03.858019 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:03.858113 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:03.859462 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:03.860242 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:03.861405 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:03.861831 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:03.861933 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:03.866132 (+ 4199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:03.866147 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:03.866163 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:03.866198 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:03.869206 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:03.869773 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:03.869779 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:03.869781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:03.869957 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:03.870257 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:03.870260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:03.870262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:03.870594 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:03.870792 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:03.871039 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 18:35:03.871198 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":363,"threads_started":1}
W20260810 18:35:03.872169 16369 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34224
W20260810 18:35:03.872781 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16219: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:35:03.872957 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 16219
I20260810 18:35:03.892438 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 15795
I20260810 18:35:03.893544 15875 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:04.010295 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 15795
2026-08-10T18:35:04Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (10112 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:04 dist-test-slave-5k54 krb5kdc[16567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:04 dist-test-slave-5k54 krb5kdc[16567](info): set up 2 sockets
Aug 10 18:35:04 dist-test-slave-5k54 krb5kdc[16567](info): commencing operation
krb5kdc: starting...
W20260810 18:35:05.170320 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:05 dist-test-slave-5k54 krb5kdc[16567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:05.383497 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37375
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:37375
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:05.709416 16586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:05.709702 16586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:05.709865 16586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:05.717308 16586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:05.717407 16586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:05.717500 16586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:05.717617 16586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:05.717686 16586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:05.727478 16586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:37375
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:05.728790 16586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:05.730146 16586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:05.742574 16591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:05.742489 16592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:05.742534 16595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:05.743225 16586 server_base.cc:1034] running on GCE node
I20260810 18:35:05.744077 16586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:05.745532 16586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:05.746810 16586 hybrid_clock.cc:648] HybridClock initialized: now 1786386905746768 us; error 48 us; skew 500 ppm
I20260810 18:35:05.747181 16586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:05 dist-test-slave-5k54 krb5kdc[16567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386905, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:05.750478 16586 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:05.752043 16586 webserver.cc:460] Webserver started at http://127.13.139.62:40643/ using document root <none> and password file <none>
I20260810 18:35:05.752720 16586 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:05.752825 16586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:05.753105 16586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:05.756155 16586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "40950f35b6e84d448d1179fd8d75e914"
format_stamp: "Formatted at 2026-08-10 18:35:05 on dist-test-slave-5k54"
server_key: "fcd1100cd8f84e627f0367485970b662"
server_key_iv: "2651b75b64a47de6f7e28e2c4f62e8fe"
server_key_version: "encryptionkey@0"
I20260810 18:35:05.756871 16586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "40950f35b6e84d448d1179fd8d75e914"
format_stamp: "Formatted at 2026-08-10 18:35:05 on dist-test-slave-5k54"
server_key: "fcd1100cd8f84e627f0367485970b662"
server_key_iv: "2651b75b64a47de6f7e28e2c4f62e8fe"
server_key_version: "encryptionkey@0"
I20260810 18:35:05.762104 16586 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:35:05.765491 16604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:05.766784 16586 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:05.766953 16586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "40950f35b6e84d448d1179fd8d75e914"
format_stamp: "Formatted at 2026-08-10 18:35:05 on dist-test-slave-5k54"
server_key: "fcd1100cd8f84e627f0367485970b662"
server_key_iv: "2651b75b64a47de6f7e28e2c4f62e8fe"
server_key_version: "encryptionkey@0"
I20260810 18:35:05.767145 16586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:05.800032 16586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:05.804540 16586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:05.804989 16586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:05.824283 16586 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:37375
I20260810 18:35:05.824321 16663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:37375 every 8 connection(s)
I20260810 18:35:05.825706 16586 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:05.829502 16664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:05.833189 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 16586
I20260810 18:35:05.833454 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:05.834127 13868 external_mini_cluster.cc:1428] Setting key d6fb3a26f2d2644855294d62735a9c48
I20260810 18:35:05.840754 16664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914: Bootstrap starting.
I20260810 18:35:05.844400 16664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:05.845610 16664 log.cc:824] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:05.849164 16664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914: No bootstrap required, opened a new log
Aug 10 18:35:05 dist-test-slave-5k54 krb5kdc[16567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:05.858078 16664 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40950f35b6e84d448d1179fd8d75e914" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37375 } }
I20260810 18:35:05.858430 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:05.836345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41704 (local address 127.13.139.62:37375)
0810 18:35:05.837171 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:05.837184 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:05.837229 (+ 45us) server_negotiation.cc:407] Connection header received
0810 18:35:05.839199 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:05.839223 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:05.839694 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:05.840010 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:05.841922 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:05.843233 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:05.845112 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:05.845842 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:05.845971 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:05.851028 (+ 5057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:05.851035 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:05.851052 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:05.851090 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:05.854327 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:05.855119 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:05.855125 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:05.855130 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:05.855295 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:05.855697 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:05.855701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:05.855703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:05.856234 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:05.856478 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:05.856925 (+ 447us) server_negotiation.cc:299] Negotiation successful
0810 18:35:05.857373 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":385,"threads_started":1}
I20260810 18:35:05.858486 16664 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:05.858603 16664 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40950f35b6e84d448d1179fd8d75e914, State: Initialized, Role: FOLLOWER
I20260810 18:35:05.859170 16664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40950f35b6e84d448d1179fd8d75e914" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37375 } }
I20260810 18:35:05.859411 16664 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:05.859570 16664 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:05.859759 16664 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:05.862453 16664 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40950f35b6e84d448d1179fd8d75e914" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37375 } }
I20260810 18:35:05.862936 16664 leader_election.cc:302] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40950f35b6e84d448d1179fd8d75e914; no voters:
I20260810 18:35:05.863592 16664 leader_election.cc:288] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:05.863739 16670 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:05.864560 16670 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [term 1 LEADER]: Becoming Leader. State: Replica: 40950f35b6e84d448d1179fd8d75e914, State: Running, Role: LEADER
I20260810 18:35:05.865144 16670 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40950f35b6e84d448d1179fd8d75e914" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37375 } }
I20260810 18:35:05.865715 16664 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:05.872304 16672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40950f35b6e84d448d1179fd8d75e914. Latest consensus state: current_term: 1 leader_uuid: "40950f35b6e84d448d1179fd8d75e914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40950f35b6e84d448d1179fd8d75e914" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37375 } } }
I20260810 18:35:05.872697 16672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:05.873167 16671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40950f35b6e84d448d1179fd8d75e914" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40950f35b6e84d448d1179fd8d75e914" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37375 } } }
I20260810 18:35:05.875903 16671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914 [sys.catalog]: This master's current role is: LEADER
W20260810 18:35:05.879618 16685 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:35:05.879741 16685 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:35:05.879935 16686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:05.881582 16686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:05.889894 16686 catalog_manager.cc:1347] Generated new cluster ID: a535cf7055894e899ba90d4d1ba9e487
I20260810 18:35:05.890031 16686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:05.900552 16686 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:05.901886 16686 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:05.910634 16686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40950f35b6e84d448d1179fd8d75e914: Generated new TSK 0
I20260810 18:35:05.911567 16686 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:35:05.971839 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37375
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:06.304049 16692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:06.304335 16692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:06.304533 16692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:06.312161 16692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:06.312270 16692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:06.312484 16692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:06.322490 16692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:06.323901 16692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:06.325269 16692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:06.338883 16701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:06.339030 16697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:06.338981 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:06.340174 16692 server_base.cc:1034] running on GCE node
I20260810 18:35:06.340891 16692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:06.342092 16692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:06.343338 16692 hybrid_clock.cc:648] HybridClock initialized: now 1786386906343272 us; error 59 us; skew 500 ppm
I20260810 18:35:06.343811 16692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:06 dist-test-slave-5k54 krb5kdc[16567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386906, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:06.348114 16692 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:35:06.349656 16692 webserver.cc:460] Webserver started at http://127.13.139.1:34001/ using document root <none> and password file <none>
I20260810 18:35:06.350389 16692 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:06.350489 16692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:06.350757 16692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:06.353864 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "ccc03e4ec0f44729b9702f979f1763e6"
format_stamp: "Formatted at 2026-08-10 18:35:06 on dist-test-slave-5k54"
server_key: "115fdf0f126fedb95d009988692863a3"
server_key_iv: "b3a2ee25c0024356ed19c8e4cfa7b04b"
server_key_version: "encryptionkey@0"
I20260810 18:35:06.354611 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "ccc03e4ec0f44729b9702f979f1763e6"
format_stamp: "Formatted at 2026-08-10 18:35:06 on dist-test-slave-5k54"
server_key: "115fdf0f126fedb95d009988692863a3"
server_key_iv: "b3a2ee25c0024356ed19c8e4cfa7b04b"
server_key_version: "encryptionkey@0"
I20260810 18:35:06.359807 16692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260810 18:35:06.363205 16708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:06.364615 16692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:06.364810 16692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "ccc03e4ec0f44729b9702f979f1763e6"
format_stamp: "Formatted at 2026-08-10 18:35:06 on dist-test-slave-5k54"
server_key: "115fdf0f126fedb95d009988692863a3"
server_key_iv: "b3a2ee25c0024356ed19c8e4cfa7b04b"
server_key_version: "encryptionkey@0"
I20260810 18:35:06.365003 16692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:06.379925 16692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:06.384325 16692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:06.384653 16692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:06.385648 16692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:06.387017 16692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:06.387089 16692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:06.387245 16692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:06.387315 16692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:06.421131 16692 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:36289
I20260810 18:35:06.421183 16837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:36289 every 8 connection(s)
I20260810 18:35:06.422473 16692 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:06.426331 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 16692
I20260810 18:35:06.426589 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:06.427484 13868 external_mini_cluster.cc:1428] Setting key 3b75f5253845c793772ab3a243024989
Aug 10 18:35:06 dist-test-slave-5k54 krb5kdc[16567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386906, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:06.445873 16841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:06.425176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:52337 (local address 127.13.139.62:37375)
0810 18:35:06.425629 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:06.425636 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:06.426885 (+ 1249us) server_negotiation.cc:407] Connection header received
0810 18:35:06.429241 (+ 2356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:06.429247 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:06.429375 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:06.429538 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:06.431691 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.432419 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.435056 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.435805 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.435962 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:06.439959 (+ 3997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:06.439964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:06.439967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:06.440002 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:06.442644 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:06.443412 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:06.443417 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:06.443458 (+ 41us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:06.443600 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:06.444052 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:06.444058 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:06.444061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:06.444330 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:06.444504 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:06.445246 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 18:35:06.445490 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":210,"threads_started":1}
I20260810 18:35:06.446816 16842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:06.425789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37375 (local address 127.13.139.1:52337)
0810 18:35:06.426695 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:06.426753 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:06.428963 (+ 2210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:06.429768 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:06.429779 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:06.430562 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:06.431472 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:06.431503 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.432600 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.432608 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:06.434825 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:06.434845 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.436116 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.436121 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:06.436346 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:06.437130 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:06.437156 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:06.439725 (+ 2569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:06.442801 (+ 3076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:06.442810 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:06.442829 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:06.443273 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:06.443716 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:06.443722 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:06.443725 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:06.443929 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:06.444463 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:06.444474 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:06.444856 (+ 382us) client_negotiation.cc:769] Sending connection context
0810 18:35:06.445128 (+ 272us) client_negotiation.cc:240] Negotiation successful
0810 18:35:06.445682 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":315,"threads_started":1}
I20260810 18:35:06.448611 16838 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37375
I20260810 18:35:06.448913 16838 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:35:06.449713 16838 heartbeater.cc:511] Master 127.13.139.62:37375 requested a full tablet report, sending...
I20260810 18:35:06.451970 16624 ts_manager.cc:194] Registered new tserver with Master: ccc03e4ec0f44729b9702f979f1763e6 (127.13.139.1:36289)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
I20260810 18:35:06.454072 16624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:52337
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:35:06.484458 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37375
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:06.809970 16845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:06.810320 16845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:06.810518 16845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:06.817996 16845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:06.818118 16845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:06.818236 16845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:06.828264 16845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:06.829576 16845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:06.830972 16845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:06.845073 16850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:06.845000 16853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:06.845093 16851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:06.845890 16845 server_base.cc:1034] running on GCE node
I20260810 18:35:06.846469 16845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:06.847380 16845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:06.848694 16845 hybrid_clock.cc:648] HybridClock initialized: now 1786386906848639 us; error 40 us; skew 500 ppm
I20260810 18:35:06.849062 16845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:06 dist-test-slave-5k54 krb5kdc[16567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386906, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:06.852365 16845 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:35:06.853879 16845 webserver.cc:460] Webserver started at http://127.13.139.2:40135/ using document root <none> and password file <none>
I20260810 18:35:06.854602 16845 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:06.854745 16845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:06.855064 16845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:06.858165 16845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "70a417505a1240f1a5da23b5860d7c27"
format_stamp: "Formatted at 2026-08-10 18:35:06 on dist-test-slave-5k54"
server_key: "fca3fbe9d02bbd16c74e019bf1dd7932"
server_key_iv: "dea5225bfc20040f0f90bbea73f0bb19"
server_key_version: "encryptionkey@0"
I20260810 18:35:06.858963 16845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "70a417505a1240f1a5da23b5860d7c27"
format_stamp: "Formatted at 2026-08-10 18:35:06 on dist-test-slave-5k54"
server_key: "fca3fbe9d02bbd16c74e019bf1dd7932"
server_key_iv: "dea5225bfc20040f0f90bbea73f0bb19"
server_key_version: "encryptionkey@0"
I20260810 18:35:06.864308 16845 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260810 18:35:06.868096 16860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:06.869771 16845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:35:06.869947 16845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "70a417505a1240f1a5da23b5860d7c27"
format_stamp: "Formatted at 2026-08-10 18:35:06 on dist-test-slave-5k54"
server_key: "fca3fbe9d02bbd16c74e019bf1dd7932"
server_key_iv: "dea5225bfc20040f0f90bbea73f0bb19"
server_key_version: "encryptionkey@0"
I20260810 18:35:06.870224 16845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:06.883107 16845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:06.887281 16845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:06.887638 16845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:06.888628 16845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:06.889986 16845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:06.890092 16845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:06.890237 16845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:06.890308 16845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:06.925313 16845 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:44625
I20260810 18:35:06.925357 16989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:44625 every 8 connection(s)
I20260810 18:35:06.926654 16845 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:06.935853 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 16845
I20260810 18:35:06.936081 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:06.936668 13868 external_mini_cluster.cc:1428] Setting key d689d1c3fa01973ced642bb1dbf75318
Aug 10 18:35:06 dist-test-slave-5k54 krb5kdc[16567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386906, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:06.950073 16841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:06.929489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:37497 (local address 127.13.139.62:37375)
0810 18:35:06.929691 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:06.929696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:06.930903 (+ 1207us) server_negotiation.cc:407] Connection header received
0810 18:35:06.932804 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:06.932810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:06.932909 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:06.933021 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:06.934565 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.935279 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.937614 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.938306 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.938438 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:06.942960 (+ 4522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:06.942969 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:06.942976 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:06.943025 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:06.946658 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:06.947662 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:06.947666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:06.947669 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:06.947801 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:06.948353 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:06.948356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:06.948358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:06.948620 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:06.948729 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:06.949637 (+ 908us) server_negotiation.cc:299] Negotiation successful
0810 18:35:06.949812 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":69}
I20260810 18:35:06.951745 16992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:06.929960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37375 (local address 127.13.139.2:37497)
0810 18:35:06.930697 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:06.930743 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:06.932526 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:06.933267 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:06.933276 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:06.933811 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:06.934390 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:06.934407 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.935470 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.935475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:06.937456 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:06.937473 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:06.938594 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:06.938604 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:06.938894 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:06.939804 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:06.939832 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:06.942671 (+ 2839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:06.946816 (+ 4145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:06.946823 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:06.946837 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:06.947512 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:06.947939 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:06.947946 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:06.947951 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:06.948230 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:06.948762 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:06.948773 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:06.949247 (+ 474us) client_negotiation.cc:769] Sending connection context
0810 18:35:06.949558 (+ 311us) client_negotiation.cc:240] Negotiation successful
0810 18:35:06.950167 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":294,"threads_started":1}
I20260810 18:35:06.953300 16990 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37375
I20260810 18:35:06.953684 16990 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:06.954457 16990 heartbeater.cc:511] Master 127.13.139.62:37375 requested a full tablet report, sending...
I20260810 18:35:06.956022 16624 ts_manager.cc:194] Registered new tserver with Master: 70a417505a1240f1a5da23b5860d7c27 (127.13.139.2:44625)
I20260810 18:35:06.956837 16624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:37497
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:35:06.991096 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37375
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:07.322816 16996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:07.323102 16996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:07.323197 16996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:07.330543 16996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:07.330698 16996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:07.330861 16996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:07.340798 16996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37375
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:07.342095 16996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:07.343348 16996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:07.357616 17002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:07.357591 17006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:07.357547 17003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:07.358429 16996 server_base.cc:1034] running on GCE node
I20260810 18:35:07.358994 16996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:07.359994 16996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:07.361250 16996 hybrid_clock.cc:648] HybridClock initialized: now 1786386907361186 us; error 59 us; skew 500 ppm
I20260810 18:35:07.361557 16996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:07 dist-test-slave-5k54 krb5kdc[16567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386907, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:07.364727 16996 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:35:07.366230 16996 webserver.cc:460] Webserver started at http://127.13.139.3:36073/ using document root <none> and password file <none>
I20260810 18:35:07.367009 16996 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:07.367187 16996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:07.367604 16996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:07.370903 16996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "ac3631033b9e4f1eb1461bfba5dad9e7"
format_stamp: "Formatted at 2026-08-10 18:35:07 on dist-test-slave-5k54"
server_key: "a31b8161a7777de69430d97e666617f7"
server_key_iv: "a88544d01a3e0374a80d498cc491b4c8"
server_key_version: "encryptionkey@0"
I20260810 18:35:07.371764 16996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "ac3631033b9e4f1eb1461bfba5dad9e7"
format_stamp: "Formatted at 2026-08-10 18:35:07 on dist-test-slave-5k54"
server_key: "a31b8161a7777de69430d97e666617f7"
server_key_iv: "a88544d01a3e0374a80d498cc491b4c8"
server_key_version: "encryptionkey@0"
I20260810 18:35:07.376988 16996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:35:07.380542 17015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:07.381826 16996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:35:07.382036 16996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "ac3631033b9e4f1eb1461bfba5dad9e7"
format_stamp: "Formatted at 2026-08-10 18:35:07 on dist-test-slave-5k54"
server_key: "a31b8161a7777de69430d97e666617f7"
server_key_iv: "a88544d01a3e0374a80d498cc491b4c8"
server_key_version: "encryptionkey@0"
I20260810 18:35:07.382252 16996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:07.405112 16996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:07.409197 16996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:07.409509 16996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:07.410543 16996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:07.411954 16996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:07.412127 16996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260810 18:35:07.412267 16996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:07.412330 16996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:07.447714 16996 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:46659
I20260810 18:35:07.447750 17141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:46659 every 8 connection(s)
I20260810 18:35:07.449002 16996 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:07.453336 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 16996
I20260810 18:35:07.453564 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:07.454142 13868 external_mini_cluster.cc:1428] Setting key 8931ab4b8d5d57ccbe1af3544c4c3ddd
I20260810 18:35:07.457983 16838 heartbeater.cc:503] Master 127.13.139.62:37375 was elected leader, sending a full tablet report...
Aug 10 18:35:07 dist-test-slave-5k54 krb5kdc[16567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386907, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:07.471211 17144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:07.451895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:49987 (local address 127.13.139.62:37375)
0810 18:35:07.452363 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:07.452368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:07.453476 (+ 1108us) server_negotiation.cc:407] Connection header received
0810 18:35:07.455647 (+ 2171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:07.455652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:07.455738 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:07.455862 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:07.457529 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:07.458459 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:07.460325 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:07.460707 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:07.460803 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:07.464453 (+ 3650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:07.464458 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:07.464461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:07.464488 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:07.467255 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:07.468254 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:07.468260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:07.468266 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:07.468462 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:07.469047 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:07.469054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:07.469058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:07.469513 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:07.469709 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:07.470701 (+ 992us) server_negotiation.cc:299] Negotiation successful
0810 18:35:07.470908 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":250,"threads_started":1}
I20260810 18:35:07.472365 17145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:07.452553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37375 (local address 127.13.139.3:49987)
0810 18:35:07.453291 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:07.453334 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:07.455331 (+ 1997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:07.456121 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:07.456132 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:07.456723 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:07.457367 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:07.457384 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:07.458623 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:07.458628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:07.460200 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:07.460212 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:07.460929 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:07.460936 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:07.461145 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:07.461906 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:07.461931 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:07.464255 (+ 2324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:07.467409 (+ 3154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:07.467418 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:07.467453 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:07.468124 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:07.468573 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:07.468577 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:07.468581 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:07.468844 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:07.469809 (+ 965us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:07.469818 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:07.470208 (+ 390us) client_negotiation.cc:769] Sending connection context
0810 18:35:07.470557 (+ 349us) client_negotiation.cc:240] Negotiation successful
0810 18:35:07.471026 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":311,"threads_started":1}
I20260810 18:35:07.474094 17142 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37375
I20260810 18:35:07.474457 17142 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:07.475274 17142 heartbeater.cc:511] Master 127.13.139.62:37375 requested a full tablet report, sending...
I20260810 18:35:07.476755 16624 ts_manager.cc:194] Registered new tserver with Master: ac3631033b9e4f1eb1461bfba5dad9e7 (127.13.139.3:46659)
I20260810 18:35:07.477562 16624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:49987
I20260810 18:35:07.482095 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 18:35:07.518870 17144 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:07.516419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41720 (local address 127.13.139.62:37375)
0810 18:35:07.516601 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:07.516606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:07.517122 (+ 516us) server_negotiation.cc:407] Connection header received
0810 18:35:07.517278 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:07.517282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:07.517347 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:07.517444 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:07.518624 (+ 1180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41720: BlockingRecv error: recv got EOF from 127.0.0.1:41720 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:35:07.522078 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16692
W20260810 18:35:07.524991 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16692: Not authorized: Client connection negotiation failed: client connection to 127.13.139.1:36289: server requires authentication, but client does not have Kerberos credentials available
I20260810 18:35:07.525184 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 16692
I20260810 18:35:07.542709 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16845
W20260810 18:35:07.545559 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16845: Not authorized: Client connection negotiation failed: client connection to 127.13.139.2:44625: server requires authentication, but client does not have Kerberos credentials available
I20260810 18:35:07.545730 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 16845
I20260810 18:35:07.563484 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16996
W20260810 18:35:07.566479 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16996: Not authorized: Client connection negotiation failed: client connection to 127.13.139.3:46659: server requires authentication, but client does not have Kerberos credentials available
I20260810 18:35:07.566602 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 16996
I20260810 18:35:07.584813 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 16586
I20260810 18:35:07.586050 16659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:07.689735 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 16586
2026-08-10T18:35:07Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3677 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:07 dist-test-slave-5k54 krb5kdc[17161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:07 dist-test-slave-5k54 krb5kdc[17161](info): set up 2 sockets
Aug 10 18:35:07 dist-test-slave-5k54 krb5kdc[17161](info): commencing operation
krb5kdc: starting...
W20260810 18:35:08.849861 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:08 dist-test-slave-5k54 krb5kdc[17161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:09.071292 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33149
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:33149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:09.397660 17175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:09.398038 17175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:09.398200 17175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:09.405416 17175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:09.405560 17175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:09.405675 17175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:09.405769 17175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:09.405860 17175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:09.415503 17175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:33149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:09.416858 17175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:09.418174 17175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:09.430188 17185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:09.430279 17181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:09.430231 17180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:09.432971 17175 server_base.cc:1034] running on GCE node
I20260810 18:35:09.433781 17175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:09.435231 17175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:09.436461 17175 hybrid_clock.cc:648] HybridClock initialized: now 1786386909436412 us; error 54 us; skew 500 ppm
I20260810 18:35:09.436826 17175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:09 dist-test-slave-5k54 krb5kdc[17161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386909, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:09.451169 17175 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:09.452978 17175 webserver.cc:460] Webserver started at http://127.13.139.62:43361/ using document root <none> and password file <none>
I20260810 18:35:09.453750 17175 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:09.453907 17175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:09.454254 17175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:09.457427 17175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "1a244053bf0b42b1b566c7e689e20935"
format_stamp: "Formatted at 2026-08-10 18:35:09 on dist-test-slave-5k54"
server_key: "74f3cf7c88896ca50e7ba18a4b78fdba"
server_key_iv: "c9fe5a3f6f873aa9152e2df9ef870924"
server_key_version: "encryptionkey@0"
I20260810 18:35:09.458247 17175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "1a244053bf0b42b1b566c7e689e20935"
format_stamp: "Formatted at 2026-08-10 18:35:09 on dist-test-slave-5k54"
server_key: "74f3cf7c88896ca50e7ba18a4b78fdba"
server_key_iv: "c9fe5a3f6f873aa9152e2df9ef870924"
server_key_version: "encryptionkey@0"
I20260810 18:35:09.463616 17175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260810 18:35:09.466948 17192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:09.468228 17175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:09.468410 17175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "1a244053bf0b42b1b566c7e689e20935"
format_stamp: "Formatted at 2026-08-10 18:35:09 on dist-test-slave-5k54"
server_key: "74f3cf7c88896ca50e7ba18a4b78fdba"
server_key_iv: "c9fe5a3f6f873aa9152e2df9ef870924"
server_key_version: "encryptionkey@0"
I20260810 18:35:09.468605 17175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:09.486234 17175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:09.490975 17175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:09.491266 17175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:09.509234 17175 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:33149
I20260810 18:35:09.509260 17251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:33149 every 8 connection(s)
I20260810 18:35:09.510759 17175 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:09.512590 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 17175
I20260810 18:35:09.512866 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:09.513854 13868 external_mini_cluster.cc:1428] Setting key 5ed9e556a2a3468f24518ba06152d790
I20260810 18:35:09.516379 17252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 18:35:09 dist-test-slave-5k54 krb5kdc[17161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:09.530881 17252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935: Bootstrap starting.
I20260810 18:35:09.534379 17252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:09.535475 17252 log.cc:824] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:09.538355 17256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:09.516027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51262 (local address 127.13.139.62:33149)
0810 18:35:09.516856 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:09.516867 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:09.516907 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:35:09.518596 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:09.518617 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:09.519063 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:09.519469 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:09.521518 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:09.522909 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:09.524917 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:09.525614 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:09.525798 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:09.530482 (+ 4684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:09.530489 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:09.530507 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:09.530541 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:09.533800 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:09.534534 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:09.534541 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:09.534547 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:09.534785 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:09.535167 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:09.535172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:09.535179 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:09.535876 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:09.536217 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:09.536668 (+ 451us) server_negotiation.cc:299] Negotiation successful
0810 18:35:09.537082 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":405,"threads_started":1}
I20260810 18:35:09.538780 17252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935: No bootstrap required, opened a new log
I20260810 18:35:09.542346 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:35:09.547251 17252 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a244053bf0b42b1b566c7e689e20935" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33149 } }
I20260810 18:35:09.547683 17252 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:09.547787 17252 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a244053bf0b42b1b566c7e689e20935, State: Initialized, Role: FOLLOWER
I20260810 18:35:09.548420 17252 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a244053bf0b42b1b566c7e689e20935" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33149 } }
I20260810 18:35:09.548672 17252 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:09.548825 17252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:09.549019 17252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:09.551136 17252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a244053bf0b42b1b566c7e689e20935" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33149 } }
I20260810 18:35:09.551699 17252 leader_election.cc:302] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a244053bf0b42b1b566c7e689e20935; no voters:
I20260810 18:35:09.552322 17252 leader_election.cc:288] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:09.552487 17259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:09.553146 17259 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [term 1 LEADER]: Becoming Leader. State: Replica: 1a244053bf0b42b1b566c7e689e20935, State: Running, Role: LEADER
I20260810 18:35:09.553694 17259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a244053bf0b42b1b566c7e689e20935" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33149 } }
I20260810 18:35:09.554648 17252 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:09.556672 17261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a244053bf0b42b1b566c7e689e20935" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a244053bf0b42b1b566c7e689e20935" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33149 } } }
I20260810 18:35:09.557132 17261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:09.561373 17260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a244053bf0b42b1b566c7e689e20935. Latest consensus state: current_term: 1 leader_uuid: "1a244053bf0b42b1b566c7e689e20935" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a244053bf0b42b1b566c7e689e20935" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33149 } } }
I20260810 18:35:09.561695 17260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:09.563162 17265 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:09.568791 17265 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:09.591704 17265 catalog_manager.cc:1347] Generated new cluster ID: 50a70ba32ab241608370477bc2b60602
I20260810 18:35:09.591840 17265 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:09.619324 17265 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:09.621387 17265 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:09.633119 17265 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a244053bf0b42b1b566c7e689e20935: Generated new TSK 0
I20260810 18:35:09.634232 17265 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:35:09.646530 17256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:09.637701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.13.139.62:33149)
0810 18:35:09.637871 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:09.637877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:09.638575 (+ 698us) server_negotiation.cc:407] Connection header received
0810 18:35:09.638716 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:09.638722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:09.638801 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:09.638930 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:09.640139 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:09.641254 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:09.642631 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:09.643315 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:09.643485 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:09.644621 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:09.644627 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:09.644634 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:09.645679 (+ 1045us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:09.645762 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:09.645802 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:09.645910 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:09.646050 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 18:35:09.646154 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 18:35:09.654572 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17175
I20260810 18:35:09.655850 17247 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:09.748066 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 17175
2026-08-10T18:35:09Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2051 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:09 dist-test-slave-5k54 krb5kdc[17291](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:09 dist-test-slave-5k54 krb5kdc[17291](info): set up 2 sockets
Aug 10 18:35:09 dist-test-slave-5k54 krb5kdc[17291](info): commencing operation
krb5kdc: starting...
W20260810 18:35:10.899864 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.008s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:11 dist-test-slave-5k54 krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:11.119305 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:45097
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:45097
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:11.442039 17306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:11.442335 17306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:11.442430 17306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:11.449636 17306 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:11.449747 17306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:11.449795 17306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:11.449852 17306 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:11.449898 17306 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:11.459686 17306 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:45097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:45097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:11.460988 17306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:11.462301 17306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:11.474388 17311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:11.474460 17315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:11.474488 17312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:11.475365 17306 server_base.cc:1034] running on GCE node
I20260810 18:35:11.476193 17306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:11.477617 17306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:11.478854 17306 hybrid_clock.cc:648] HybridClock initialized: now 1786386911478800 us; error 82 us; skew 500 ppm
I20260810 18:35:11.479207 17306 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:11 dist-test-slave-5k54 krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386911, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:11.482605 17306 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:11.484225 17306 webserver.cc:460] Webserver started at http://127.13.139.62:44109/ using document root <none> and password file <none>
I20260810 18:35:11.484912 17306 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:11.485059 17306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:11.485376 17306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:11.488444 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "b2ad8cce39234201a0c2d7799c4ee87f"
format_stamp: "Formatted at 2026-08-10 18:35:11 on dist-test-slave-5k54"
server_key: "0d55f7b53dc0994b2fed88fda94579e0"
server_key_iv: "3de8f845321267430a6299048131baba"
server_key_version: "encryptionkey@0"
I20260810 18:35:11.489384 17306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "b2ad8cce39234201a0c2d7799c4ee87f"
format_stamp: "Formatted at 2026-08-10 18:35:11 on dist-test-slave-5k54"
server_key: "0d55f7b53dc0994b2fed88fda94579e0"
server_key_iv: "3de8f845321267430a6299048131baba"
server_key_version: "encryptionkey@0"
I20260810 18:35:11.494997 17306 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260810 18:35:11.498495 17322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:11.499827 17306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:11.500047 17306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "b2ad8cce39234201a0c2d7799c4ee87f"
format_stamp: "Formatted at 2026-08-10 18:35:11 on dist-test-slave-5k54"
server_key: "0d55f7b53dc0994b2fed88fda94579e0"
server_key_iv: "3de8f845321267430a6299048131baba"
server_key_version: "encryptionkey@0"
I20260810 18:35:11.500239 17306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:11.520298 17306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:11.524727 17306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:11.525044 17306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:11.543788 17306 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:45097
I20260810 18:35:11.543836 17381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:45097 every 8 connection(s)
I20260810 18:35:11.545215 17306 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:11.549182 17382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:11.549499 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 17306
I20260810 18:35:11.549734 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:11.550621 13868 external_mini_cluster.cc:1428] Setting key 277fdd9f17eab36105c7a2d7836f53ca
I20260810 18:35:11.563763 17382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f: Bootstrap starting.
Aug 10 18:35:11 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:11.567408 17382 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:11.568588 17382 log.cc:824] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:11.572124 17382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f: No bootstrap required, opened a new log
I20260810 18:35:11.575163 17386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:11.552842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58054 (local address 127.13.139.62:45097)
0810 18:35:11.553709 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:11.553720 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:11.553764 (+ 44us) server_negotiation.cc:407] Connection header received
0810 18:35:11.555777 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:11.555800 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:11.556209 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:11.556571 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:11.558298 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:11.559642 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:11.561417 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:11.562062 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:11.562200 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:11.566853 (+ 4653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:11.566861 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:11.566875 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:11.566908 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:11.570623 (+ 3715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:11.571287 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:11.571295 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:11.571303 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:11.571539 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:11.571936 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:11.571948 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:11.571951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:11.572700 (+ 749us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:11.573024 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:11.573363 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 18:35:11.573796 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":407,"threads_started":1}
I20260810 18:35:11.581287 17382 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45097 } }
I20260810 18:35:11.581624 17382 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:11.581702 17382 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2ad8cce39234201a0c2d7799c4ee87f, State: Initialized, Role: FOLLOWER
I20260810 18:35:11.582278 17382 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45097 } }
I20260810 18:35:11.582489 17382 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:11.582631 17382 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:11.582906 17382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:11.585253 17382 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45097 } }
I20260810 18:35:11.585732 17382 leader_election.cc:302] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2ad8cce39234201a0c2d7799c4ee87f; no voters:
I20260810 18:35:11.586295 17382 leader_election.cc:288] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:11.586437 17389 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:11.587168 17389 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [term 1 LEADER]: Becoming Leader. State: Replica: b2ad8cce39234201a0c2d7799c4ee87f, State: Running, Role: LEADER
I20260810 18:35:11.587742 17389 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45097 } }
I20260810 18:35:11.588413 17382 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:11.590852 17391 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2ad8cce39234201a0c2d7799c4ee87f. Latest consensus state: current_term: 1 leader_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45097 } } }
I20260810 18:35:11.591217 17391 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:11.591189 17390 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2ad8cce39234201a0c2d7799c4ee87f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45097 } } }
I20260810 18:35:11.591703 17390 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:11.593400 17396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:11.598863 17396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:11.608259 17396 catalog_manager.cc:1347] Generated new cluster ID: 15174ebdc80a459ab2c96ad58155379e
I20260810 18:35:11.608397 17396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:11.621899 17396 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:11.623337 17396 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:11.636221 17396 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2ad8cce39234201a0c2d7799c4ee87f: Generated new TSK 0
I20260810 18:35:11.637373 17396 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:35:11.695164 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45097
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:12.022876 17413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:12.023136 17413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:12.023332 17413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:12.030954 17413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:12.031054 17413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:12.031255 17413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:12.040952 17413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:12.042218 17413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:12.043620 17413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:12.057152 17419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:12.057260 17418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:12.057232 17421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:12.058360 17413 server_base.cc:1034] running on GCE node
I20260810 18:35:12.058955 17413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:12.059959 17413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:12.061152 17413 hybrid_clock.cc:648] HybridClock initialized: now 1786386912061089 us; error 54 us; skew 500 ppm
I20260810 18:35:12.061470 17413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:12 dist-test-slave-5k54 krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386912, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:12.064682 17413 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:35:12.066025 17413 webserver.cc:460] Webserver started at http://127.13.139.1:35425/ using document root <none> and password file <none>
I20260810 18:35:12.066655 17413 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:12.066754 17413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:12.067005 17413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:12.069867 17413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "fd13eee8ec83434fb0fc4b4efbac0027"
format_stamp: "Formatted at 2026-08-10 18:35:12 on dist-test-slave-5k54"
server_key: "654c75246214944b9b0a73ce64a72fda"
server_key_iv: "f9367154e76318e2101752e425577272"
server_key_version: "encryptionkey@0"
I20260810 18:35:12.070729 17413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "fd13eee8ec83434fb0fc4b4efbac0027"
format_stamp: "Formatted at 2026-08-10 18:35:12 on dist-test-slave-5k54"
server_key: "654c75246214944b9b0a73ce64a72fda"
server_key_iv: "f9367154e76318e2101752e425577272"
server_key_version: "encryptionkey@0"
I20260810 18:35:12.076345 17413 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 18:35:12.079643 17429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:12.080905 17413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:35:12.081035 17413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "fd13eee8ec83434fb0fc4b4efbac0027"
format_stamp: "Formatted at 2026-08-10 18:35:12 on dist-test-slave-5k54"
server_key: "654c75246214944b9b0a73ce64a72fda"
server_key_iv: "f9367154e76318e2101752e425577272"
server_key_version: "encryptionkey@0"
I20260810 18:35:12.081197 17413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:12.094700 17413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:12.098961 17413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:12.099215 17413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:12.100196 17413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:12.101459 17413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:12.101531 17413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:12.101614 17413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:12.101660 17413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:12.134095 17413 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:41245
I20260810 18:35:12.134145 17555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:41245 every 8 connection(s)
I20260810 18:35:12.135679 17413 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:12.136288 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 17413
I20260810 18:35:12.136526 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:12.137446 13868 external_mini_cluster.cc:1428] Setting key 4f665f0e483ebe61b12059e44e8d05f0
Aug 10 18:35:12 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386912, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:12.157564 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:12.138536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:44867 (local address 127.13.139.62:45097)
0810 18:35:12.139017 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:12.139021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:12.140227 (+ 1206us) server_negotiation.cc:407] Connection header received
0810 18:35:12.142069 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:12.142074 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:12.142170 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:12.142283 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:12.143868 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.144599 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.146190 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.146848 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.146992 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:12.150418 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:12.150427 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:12.150436 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:12.150482 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:12.154146 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:12.154876 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:12.154884 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:12.154890 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:12.155043 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:12.155483 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:12.155491 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:12.155497 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:12.155908 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:12.156075 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:12.156779 (+ 704us) server_negotiation.cc:299] Negotiation successful
0810 18:35:12.157072 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":264,"threads_started":1}
I20260810 18:35:12.158118 17559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:12.139217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:45097 (local address 127.13.139.1:44867)
0810 18:35:12.140075 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:12.140123 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:12.141798 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:12.142526 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:12.142534 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:12.143058 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:12.143702 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:12.143722 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.144783 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.144787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:12.146032 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:12.146043 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.147073 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.147078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:12.147280 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:12.148042 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:12.148064 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:12.150187 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:12.154294 (+ 4107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:12.154301 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:12.154314 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:12.154734 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:12.155153 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:12.155156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:12.155158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:12.155333 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:12.156046 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:12.156052 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:12.156367 (+ 315us) client_negotiation.cc:769] Sending connection context
0810 18:35:12.156599 (+ 232us) client_negotiation.cc:240] Negotiation successful
0810 18:35:12.156987 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":388,"threads_started":1}
I20260810 18:35:12.159759 17556 heartbeater.cc:347] Connected to a master server at 127.13.139.62:45097
I20260810 18:35:12.160104 17556 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:35:12.160959 17556 heartbeater.cc:511] Master 127.13.139.62:45097 requested a full tablet report, sending...
I20260810 18:35:12.163108 17341 ts_manager.cc:194] Registered new tserver with Master: fd13eee8ec83434fb0fc4b4efbac0027 (127.13.139.1:41245)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
I20260810 18:35:12.165390 17341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:44867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:35:12.189098 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45097
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:12.513603 17562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:12.513940 17562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:12.514111 17562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:12.521373 17562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:12.521528 17562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:12.521708 17562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:12.531481 17562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:12.532832 17562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:12.534310 17562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:12.547626 17569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:12.547868 17568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:12.548251 17571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:12.552984 17562 server_base.cc:1034] running on GCE node
I20260810 18:35:12.553623 17562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:12.554596 17562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:12.555820 17562 hybrid_clock.cc:648] HybridClock initialized: now 1786386912555769 us; error 45 us; skew 500 ppm
I20260810 18:35:12.556125 17562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:12 dist-test-slave-5k54 krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386912, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:12.559526 17562 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:35:12.561057 17562 webserver.cc:460] Webserver started at http://127.13.139.2:43005/ using document root <none> and password file <none>
I20260810 18:35:12.561764 17562 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:12.561931 17562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:12.562240 17562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:12.565178 17562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "4244cc2435ed4b68bf1c7fa4fb217cd4"
format_stamp: "Formatted at 2026-08-10 18:35:12 on dist-test-slave-5k54"
server_key: "e628b5615429258ca64b565dc892e1da"
server_key_iv: "0c0c1fcc4cc35cce4c02d53c74c05364"
server_key_version: "encryptionkey@0"
I20260810 18:35:12.565953 17562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "4244cc2435ed4b68bf1c7fa4fb217cd4"
format_stamp: "Formatted at 2026-08-10 18:35:12 on dist-test-slave-5k54"
server_key: "e628b5615429258ca64b565dc892e1da"
server_key_iv: "0c0c1fcc4cc35cce4c02d53c74c05364"
server_key_version: "encryptionkey@0"
I20260810 18:35:12.571645 17562 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260810 18:35:12.574947 17579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:12.576289 17562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:12.576481 17562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "4244cc2435ed4b68bf1c7fa4fb217cd4"
format_stamp: "Formatted at 2026-08-10 18:35:12 on dist-test-slave-5k54"
server_key: "e628b5615429258ca64b565dc892e1da"
server_key_iv: "0c0c1fcc4cc35cce4c02d53c74c05364"
server_key_version: "encryptionkey@0"
I20260810 18:35:12.576689 17562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:12.592000 17562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:12.596346 17562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:12.596648 17562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:12.597626 17562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:12.598960 17562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:12.599033 17562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:12.599195 17562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:12.599246 17562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:12.631363 17562 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:41451
I20260810 18:35:12.631412 17706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:41451 every 8 connection(s)
I20260810 18:35:12.632676 17562 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:12.638723 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 17562
I20260810 18:35:12.638955 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:12.639488 13868 external_mini_cluster.cc:1428] Setting key cc029f4b7e030fa68c617c77e2b8cbf0
Aug 10 18:35:12 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386912, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:12.654347 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:12.635477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:56073 (local address 127.13.139.62:45097)
0810 18:35:12.635659 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:12.635664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:12.636807 (+ 1143us) server_negotiation.cc:407] Connection header received
0810 18:35:12.638748 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:12.638753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:12.638846 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:12.638984 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:12.640823 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.641753 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.643320 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.644068 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.644213 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:12.647842 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:12.647851 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:12.647858 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:12.647904 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:12.650845 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:12.651758 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:12.651767 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:12.651774 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:12.651959 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:12.652383 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:12.652392 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:12.652398 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:12.652782 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:12.652935 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:12.653603 (+ 668us) server_negotiation.cc:299] Negotiation successful
0810 18:35:12.653877 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":62}
I20260810 18:35:12.654963 17710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:12.635886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:45097 (local address 127.13.139.2:56073)
0810 18:35:12.636655 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:12.636696 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:12.638439 (+ 1743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:12.639220 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:12.639228 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:12.639840 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:12.640642 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:12.640666 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.641930 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.641934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:12.643169 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:12.643181 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:12.644265 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:12.644270 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:12.644476 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:12.645166 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:12.645189 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:12.647616 (+ 2427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:12.650992 (+ 3376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:12.650999 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:12.651012 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:12.651610 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:12.652072 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:12.652075 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:12.652078 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:12.652266 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:12.652901 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:12.652912 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:12.653219 (+ 307us) client_negotiation.cc:769] Sending connection context
0810 18:35:12.653447 (+ 228us) client_negotiation.cc:240] Negotiation successful
0810 18:35:12.653837 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":350,"threads_started":1}
I20260810 18:35:12.656538 17708 heartbeater.cc:347] Connected to a master server at 127.13.139.62:45097
I20260810 18:35:12.656870 17708 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:12.657843 17708 heartbeater.cc:511] Master 127.13.139.62:45097 requested a full tablet report, sending...
I20260810 18:35:12.659621 17341 ts_manager.cc:194] Registered new tserver with Master: 4244cc2435ed4b68bf1c7fa4fb217cd4 (127.13.139.2:41451)
I20260810 18:35:12.660437 17341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:56073
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:35:12.694761 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45097
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:13.041544 17713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:13.041821 17713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:13.041913 17713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:13.049053 17713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:13.049187 17713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:13.049366 17713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:13.059257 17713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:13.060612 17713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:13.061954 17713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:13.075449 17719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:13.075536 17718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:13.075565 17722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:13.076437 17713 server_base.cc:1034] running on GCE node
I20260810 18:35:13.077039 17713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:13.077962 17713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:13.079161 17713 hybrid_clock.cc:648] HybridClock initialized: now 1786386913079110 us; error 40 us; skew 500 ppm
I20260810 18:35:13.079550 17713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386913, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:13.082906 17713 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:35:13.084393 17713 webserver.cc:460] Webserver started at http://127.13.139.3:35787/ using document root <none> and password file <none>
I20260810 18:35:13.085151 17713 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:13.085301 17713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:13.085615 17713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:13.088562 17713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "d53f4433a26f4064a16080d354e823ac"
format_stamp: "Formatted at 2026-08-10 18:35:13 on dist-test-slave-5k54"
server_key: "435a81dd0cf46dffcd1535adf0346028"
server_key_iv: "ed5ee9f84abd69229b7f65b4fb9017d6"
server_key_version: "encryptionkey@0"
I20260810 18:35:13.089417 17713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "d53f4433a26f4064a16080d354e823ac"
format_stamp: "Formatted at 2026-08-10 18:35:13 on dist-test-slave-5k54"
server_key: "435a81dd0cf46dffcd1535adf0346028"
server_key_iv: "ed5ee9f84abd69229b7f65b4fb9017d6"
server_key_version: "encryptionkey@0"
I20260810 18:35:13.094493 17713 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260810 18:35:13.097882 17729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:13.099207 17713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:13.099382 17713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "d53f4433a26f4064a16080d354e823ac"
format_stamp: "Formatted at 2026-08-10 18:35:13 on dist-test-slave-5k54"
server_key: "435a81dd0cf46dffcd1535adf0346028"
server_key_iv: "ed5ee9f84abd69229b7f65b4fb9017d6"
server_key_version: "encryptionkey@0"
I20260810 18:35:13.099638 17713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:13.118950 17713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:13.123590 17713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:13.123895 17713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:13.124883 17713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:13.126392 17713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:13.126495 17713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:13.126647 17713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:13.126718 17713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:13.162186 17713 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:44941
I20260810 18:35:13.162222 17852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:44941 every 8 connection(s)
I20260810 18:35:13.163565 17713 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:13.164330 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 17713
I20260810 18:35:13.164536 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:13.165105 13868 external_mini_cluster.cc:1428] Setting key 6970abf726de47d5e73f1f87da1e4a02
I20260810 18:35:13.168417 17556 heartbeater.cc:503] Master 127.13.139.62:45097 was elected leader, sending a full tablet report...
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386913, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:13.183667 17855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:13.166202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:34839 (local address 127.13.139.62:45097)
0810 18:35:13.166670 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:13.166675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:13.167844 (+ 1169us) server_negotiation.cc:407] Connection header received
0810 18:35:13.169850 (+ 2006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:13.169855 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:13.169933 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:13.170060 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:13.171521 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.172328 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.173851 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.174278 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.174406 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:13.177749 (+ 3343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:13.177754 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:13.177757 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:13.177786 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:13.180941 (+ 3155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.181705 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.181709 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.181711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.181829 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.182210 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.182213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.182215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.182468 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:13.182571 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:13.183178 (+ 607us) server_negotiation.cc:299] Negotiation successful
0810 18:35:13.183328 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":254,"threads_started":1}
I20260810 18:35:13.184598 17856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:13.166833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:45097 (local address 127.13.139.3:34839)
0810 18:35:13.167672 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:13.167724 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:13.169588 (+ 1864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:13.170298 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:13.170306 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:13.170786 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:13.171327 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:13.171344 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.172486 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.172491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:13.173707 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:13.173719 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.174509 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.174517 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:13.174746 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:13.175365 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:13.175391 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:13.177554 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:13.181081 (+ 3527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:13.181091 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:13.181105 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:13.181595 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:13.181938 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:13.181941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:13.181943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:13.182112 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:13.182568 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:13.182574 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:13.182852 (+ 278us) client_negotiation.cc:769] Sending connection context
0810 18:35:13.183092 (+ 240us) client_negotiation.cc:240] Negotiation successful
0810 18:35:13.183513 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":343,"threads_started":1}
I20260810 18:35:13.186056 17853 heartbeater.cc:347] Connected to a master server at 127.13.139.62:45097
I20260810 18:35:13.186338 17853 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:13.187055 17853 heartbeater.cc:511] Master 127.13.139.62:45097 requested a full tablet report, sending...
I20260810 18:35:13.188439 17341 ts_manager.cc:194] Registered new tserver with Master: d53f4433a26f4064a16080d354e823ac (127.13.139.3:44941)
I20260810 18:35:13.189384 17341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:34839
I20260810 18:35:13.193054 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17291](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386913, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386913, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:13.245682 17855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:13.232060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58056 (local address 127.13.139.62:45097)
0810 18:35:13.232320 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:13.232330 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:13.232700 (+ 370us) server_negotiation.cc:407] Connection header received
0810 18:35:13.232851 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:13.232855 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:13.232923 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:13.233019 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:13.234320 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.235053 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.236316 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.236724 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.236818 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:13.240577 (+ 3759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:13.240581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:13.240585 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:13.240617 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:13.243200 (+ 2583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.243858 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.243862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.243865 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.243989 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.244311 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.244314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.244316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.244644 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:13.244847 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:13.245178 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 18:35:13.245348 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260810 18:35:13.246341 17341 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58056
I20260810 18:35:13.248411 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17413
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386913, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:13.264505 17866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:13.249240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59562 (local address 127.13.139.1:41245)
0810 18:35:13.249882 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:13.249890 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:13.250295 (+ 405us) server_negotiation.cc:407] Connection header received
0810 18:35:13.250517 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:13.250526 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:13.250736 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:13.250919 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:13.252217 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.253279 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.254515 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.255093 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.255239 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:13.259070 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:13.259081 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:13.259095 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:13.259131 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:13.261775 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.262415 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.262422 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.262424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.262549 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.262927 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.262939 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.262941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.263264 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:13.263600 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:13.263896 (+ 296us) server_negotiation.cc:299] Negotiation successful
0810 18:35:13.264171 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":317,"threads_started":1}
W20260810 18:35:13.265815 17551 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59562
W20260810 18:35:13.266844 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17413: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:35:13.267074 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 17413
I20260810 18:35:13.286866 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17562
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386913, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:35:13.302745 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:13.287754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50638 (local address 127.13.139.2:41451)
0810 18:35:13.288335 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:13.288343 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:13.288368 (+ 25us) server_negotiation.cc:407] Connection header received
0810 18:35:13.288429 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:13.288435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:13.288643 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:13.288775 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:13.290067 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.291116 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.292460 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.293000 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.293096 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:13.297163 (+ 4067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:13.297173 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:13.297187 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:13.297218 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:13.300338 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.300905 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.300911 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.300913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.301041 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.301353 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.301356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.301358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.301675 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:13.301928 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:13.302188 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 18:35:13.302450 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":323,"threads_started":1}
W20260810 18:35:13.304136 17702 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50638
W20260810 18:35:13.305361 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17562: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:35:13.305495 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 17562
I20260810 18:35:13.323158 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17713
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17291](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386913, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:35:13.339798 17869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:13.324088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53918 (local address 127.13.139.3:44941)
0810 18:35:13.324765 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:13.324787 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:13.324816 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:35:13.324877 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:13.324883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:13.325096 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:13.325225 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:13.326600 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.327786 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.329108 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:13.329674 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:13.329822 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:13.334150 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:13.334162 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:13.334176 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:13.334224 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:13.336953 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.337630 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.337638 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.337640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.337762 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:13.338144 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:13.338149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:13.338152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:13.338503 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:13.338824 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:13.339142 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 18:35:13.339459 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":317,"threads_started":1}
W20260810 18:35:13.341075 17848 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53918
W20260810 18:35:13.342202 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17713: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:35:13.342387 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 17713
I20260810 18:35:13.361936 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17306
I20260810 18:35:13.363127 17373 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:13.468711 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 17306
2026-08-10T18:35:13Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3727 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17874](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17874](info): set up 2 sockets
Aug 10 18:35:13 dist-test-slave-5k54 krb5kdc[17874](info): commencing operation
krb5kdc: starting...
W20260810 18:35:14.641333 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.005s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:14 dist-test-slave-5k54 krb5kdc[17874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:14.857038 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43663
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:43663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:15.183025 17892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:15.183352 17892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:15.183539 17892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:15.190647 17892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:15.190785 17892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:15.190893 17892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:15.190997 17892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:15.191085 17892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:15.200879 17892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:43663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:15.202242 17892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:15.203603 17892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:15.215447 17898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:15.215381 17900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:15.215500 17897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:15.216491 17892 server_base.cc:1034] running on GCE node
I20260810 18:35:15.217274 17892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:15.218626 17892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:15.219854 17892 hybrid_clock.cc:648] HybridClock initialized: now 1786386915219809 us; error 52 us; skew 500 ppm
I20260810 18:35:15.220194 17892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:15 dist-test-slave-5k54 krb5kdc[17874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386915, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:15.228691 17892 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:15.230150 17892 webserver.cc:460] Webserver started at http://127.13.139.62:42301/ using document root <none> and password file <none>
I20260810 18:35:15.230809 17892 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:15.230909 17892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:15.231258 17892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:15.234295 17892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "01403a24a2c244b28c11e5555429ddea"
format_stamp: "Formatted at 2026-08-10 18:35:15 on dist-test-slave-5k54"
server_key: "94c5833ba4039d1d03f57b8fcbc99302"
server_key_iv: "67f6ceac75606c6c1a3c84b377f55ed0"
server_key_version: "encryptionkey@0"
I20260810 18:35:15.235041 17892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "01403a24a2c244b28c11e5555429ddea"
format_stamp: "Formatted at 2026-08-10 18:35:15 on dist-test-slave-5k54"
server_key: "94c5833ba4039d1d03f57b8fcbc99302"
server_key_iv: "67f6ceac75606c6c1a3c84b377f55ed0"
server_key_version: "encryptionkey@0"
I20260810 18:35:15.240121 17892 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260810 18:35:15.243625 17910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:15.244992 17892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:35:15.245126 17892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "01403a24a2c244b28c11e5555429ddea"
format_stamp: "Formatted at 2026-08-10 18:35:15 on dist-test-slave-5k54"
server_key: "94c5833ba4039d1d03f57b8fcbc99302"
server_key_iv: "67f6ceac75606c6c1a3c84b377f55ed0"
server_key_version: "encryptionkey@0"
I20260810 18:35:15.245280 17892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:15.267700 17892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:15.271916 17892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:15.272152 17892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:15.289686 17892 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:43663
I20260810 18:35:15.289717 17965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:43663 every 8 connection(s)
I20260810 18:35:15.291018 17892 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:15.294817 17966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:15.297708 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 17892
I20260810 18:35:15.297968 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:15.298643 13868 external_mini_cluster.cc:1428] Setting key beefa9118e29b73729df51a5e1e3b928
I20260810 18:35:15.307374 17966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea: Bootstrap starting.
I20260810 18:35:15.311225 17966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:15.312615 17966 log.cc:824] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea: Log is configured to *not* fsync() on all Append() calls
Aug 10 18:35:15 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:15.315802 17966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea: No bootstrap required, opened a new log
I20260810 18:35:15.322098 17970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:15.300745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48204 (local address 127.13.139.62:43663)
0810 18:35:15.301545 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:15.301556 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:15.301597 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:35:15.303202 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:15.303224 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:15.303691 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:15.304028 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:15.305929 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:15.307205 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:15.308996 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:15.309665 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:15.309790 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:15.314803 (+ 5013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:15.314811 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:15.314825 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:15.314860 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:15.317992 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:15.318685 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:15.318692 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:15.318701 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:15.318861 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:15.319243 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:15.319248 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:15.319251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:15.319860 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:15.320222 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:15.320672 (+ 450us) server_negotiation.cc:299] Negotiation successful
0810 18:35:15.321109 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":362,"threads_started":1}
I20260810 18:35:15.323910 17966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01403a24a2c244b28c11e5555429ddea" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43663 } }
I20260810 18:35:15.324288 17966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:15.324412 17966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01403a24a2c244b28c11e5555429ddea, State: Initialized, Role: FOLLOWER
I20260810 18:35:15.325037 17966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01403a24a2c244b28c11e5555429ddea" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43663 } }
I20260810 18:35:15.325311 17966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:15.325449 17966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:15.325637 17966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:15.328191 17966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01403a24a2c244b28c11e5555429ddea" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43663 } }
I20260810 18:35:15.328663 17966 leader_election.cc:302] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01403a24a2c244b28c11e5555429ddea; no voters:
I20260810 18:35:15.329216 17966 leader_election.cc:288] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:15.329384 17972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:15.330098 17972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [term 1 LEADER]: Becoming Leader. State: Replica: 01403a24a2c244b28c11e5555429ddea, State: Running, Role: LEADER
I20260810 18:35:15.330710 17972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01403a24a2c244b28c11e5555429ddea" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43663 } }
I20260810 18:35:15.331624 17966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:15.333806 17975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01403a24a2c244b28c11e5555429ddea. Latest consensus state: current_term: 1 leader_uuid: "01403a24a2c244b28c11e5555429ddea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01403a24a2c244b28c11e5555429ddea" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43663 } } }
I20260810 18:35:15.333817 17974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01403a24a2c244b28c11e5555429ddea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01403a24a2c244b28c11e5555429ddea" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43663 } } }
I20260810 18:35:15.334267 17974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:15.334271 17975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:15.336398 17980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:15.340792 17980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:15.354233 17980 catalog_manager.cc:1347] Generated new cluster ID: b368e0e042a14e75b109742e4f5c6d09
I20260810 18:35:15.354344 17980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:15.375109 17980 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:15.376551 17980 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:15.385673 17980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01403a24a2c244b28c11e5555429ddea: Generated new TSK 0
I20260810 18:35:15.386492 17980 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:35:15.443408 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:43663
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:15.775882 17998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:15.776170 17998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:15.776266 17998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:15.783267 17998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:15.783366 17998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:15.783531 17998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:15.793284 17998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:43663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:15.794485 17998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:15.795774 17998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:15.808962 18004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:15.809017 18006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:15.809060 18003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:15.810272 17998 server_base.cc:1034] running on GCE node
I20260810 18:35:15.810981 17998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:15.811869 17998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:15.813060 17998 hybrid_clock.cc:648] HybridClock initialized: now 1786386915813026 us; error 31 us; skew 500 ppm
I20260810 18:35:15.813373 17998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:15 dist-test-slave-5k54 krb5kdc[17874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386915, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:15.816699 17998 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:35:15.818013 17998 webserver.cc:460] Webserver started at http://127.13.139.1:37537/ using document root <none> and password file <none>
I20260810 18:35:15.818640 17998 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:15.818739 17998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:15.818993 17998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:15.822140 17998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "73dacc973c6c4625908ec9eadf603d9e"
format_stamp: "Formatted at 2026-08-10 18:35:15 on dist-test-slave-5k54"
server_key: "d14e105168fec1d0e1fb559ab17ca322"
server_key_iv: "6518abed39b481417637cfa9fd2f3de7"
server_key_version: "encryptionkey@0"
I20260810 18:35:15.822882 17998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "73dacc973c6c4625908ec9eadf603d9e"
format_stamp: "Formatted at 2026-08-10 18:35:15 on dist-test-slave-5k54"
server_key: "d14e105168fec1d0e1fb559ab17ca322"
server_key_iv: "6518abed39b481417637cfa9fd2f3de7"
server_key_version: "encryptionkey@0"
I20260810 18:35:15.827962 17998 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260810 18:35:15.831321 18014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:15.832854 17998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260810 18:35:15.833002 17998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "73dacc973c6c4625908ec9eadf603d9e"
format_stamp: "Formatted at 2026-08-10 18:35:15 on dist-test-slave-5k54"
server_key: "d14e105168fec1d0e1fb559ab17ca322"
server_key_iv: "6518abed39b481417637cfa9fd2f3de7"
server_key_version: "encryptionkey@0"
I20260810 18:35:15.833177 17998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:15.852043 17998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:15.856688 17998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:15.856945 17998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:15.857846 17998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:15.859124 17998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:15.859196 17998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:15.859282 17998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:15.859328 17998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:15.892506 17998 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:34075
I20260810 18:35:15.892539 18145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:34075 every 8 connection(s)
I20260810 18:35:15.893838 17998 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:15.895336 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 17998
I20260810 18:35:15.895622 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:15.896389 13868 external_mini_cluster.cc:1428] Setting key fb643a7b42d4ebfacbd17fb09b568908
Aug 10 18:35:15 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386915, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:15.916045 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:15.896542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:55759 (local address 127.13.139.62:43663)
0810 18:35:15.897037 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:15.897044 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:15.898238 (+ 1194us) server_negotiation.cc:407] Connection header received
0810 18:35:15.900257 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:15.900265 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:15.900359 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:15.900497 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:15.901997 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:15.903166 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:15.904865 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:15.905585 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:15.905732 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:15.909901 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:15.909906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:15.909909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:15.909944 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:15.912571 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:15.913516 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:15.913520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:15.913522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:15.913633 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:15.914240 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:15.914243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:15.914245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:15.914504 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:15.914612 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:15.915625 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0810 18:35:15.915791 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":227,"threads_started":1}
I20260810 18:35:15.917745 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:15.897124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:43663 (local address 127.13.139.1:55759)
0810 18:35:15.898050 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:15.898105 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:15.899987 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:15.900696 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:15.900704 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:15.901207 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:15.901788 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:15.901805 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:15.903345 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:15.903348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:15.904702 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:15.904714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:15.905799 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:15.905804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:15.906011 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:15.906755 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:15.906783 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:15.909671 (+ 2888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:15.912715 (+ 3044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:15.912726 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:15.912746 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:15.913394 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:15.913756 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:15.913763 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:15.913768 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:15.914101 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:15.914632 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:15.914643 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:15.915138 (+ 495us) client_negotiation.cc:769] Sending connection context
0810 18:35:15.915524 (+ 386us) client_negotiation.cc:240] Negotiation successful
0810 18:35:15.916171 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":361,"threads_started":1}
I20260810 18:35:15.919500 18146 heartbeater.cc:347] Connected to a master server at 127.13.139.62:43663
I20260810 18:35:15.919827 18146 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:15.920605 18146 heartbeater.cc:511] Master 127.13.139.62:43663 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:35:15.922837 17927 ts_manager.cc:194] Registered new tserver with Master: 73dacc973c6c4625908ec9eadf603d9e (127.13.139.1:34075)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
I20260810 18:35:15.924613 17927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:55759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:35:15.951232 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:43663
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:16.274140 18153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:16.274410 18153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:16.274514 18153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:16.281599 18153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:16.281705 18153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:16.281816 18153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:16.291282 18153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:43663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:16.292516 18153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:16.293834 18153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:16.307092 18159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:16.307184 18158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:16.307181 18161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:16.308035 18153 server_base.cc:1034] running on GCE node
I20260810 18:35:16.308646 18153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:16.309571 18153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:16.310803 18153 hybrid_clock.cc:648] HybridClock initialized: now 1786386916310759 us; error 57 us; skew 500 ppm
I20260810 18:35:16.311123 18153 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:16 dist-test-slave-5k54 krb5kdc[17874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:16.314424 18153 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:35:16.315922 18153 webserver.cc:460] Webserver started at http://127.13.139.2:37403/ using document root <none> and password file <none>
I20260810 18:35:16.316596 18153 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:16.316728 18153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:16.317052 18153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:16.319955 18153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "e099e4ea89ca4b4a8e671647bbe15904"
format_stamp: "Formatted at 2026-08-10 18:35:16 on dist-test-slave-5k54"
server_key: "c48493d25072dfd8123c4ab5209e0132"
server_key_iv: "d6972ce6e2eaa6fdf314e850e2ca1de9"
server_key_version: "encryptionkey@0"
I20260810 18:35:16.320835 18153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "e099e4ea89ca4b4a8e671647bbe15904"
format_stamp: "Formatted at 2026-08-10 18:35:16 on dist-test-slave-5k54"
server_key: "c48493d25072dfd8123c4ab5209e0132"
server_key_iv: "d6972ce6e2eaa6fdf314e850e2ca1de9"
server_key_version: "encryptionkey@0"
I20260810 18:35:16.325896 18153 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260810 18:35:16.329352 18170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:16.330650 18153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:16.330812 18153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "e099e4ea89ca4b4a8e671647bbe15904"
format_stamp: "Formatted at 2026-08-10 18:35:16 on dist-test-slave-5k54"
server_key: "c48493d25072dfd8123c4ab5209e0132"
server_key_iv: "d6972ce6e2eaa6fdf314e850e2ca1de9"
server_key_version: "encryptionkey@0"
I20260810 18:35:16.331012 18153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:16.350162 18153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:16.354456 18153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:16.354734 18153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:16.355684 18153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:16.357018 18153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:16.357118 18153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:16.357264 18153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:16.357334 18153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:16.390476 18153 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:43649
I20260810 18:35:16.390517 18292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:43649 every 8 connection(s)
I20260810 18:35:16.391896 18153 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:16.401760 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 18153
I20260810 18:35:16.401981 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:16.402539 13868 external_mini_cluster.cc:1428] Setting key eeaeb9f87a58f5f23816609f0ab42b18
Aug 10 18:35:16 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:16.413224 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:16.394487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:56077 (local address 127.13.139.62:43663)
0810 18:35:16.394706 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:16.394712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:16.395939 (+ 1227us) server_negotiation.cc:407] Connection header received
0810 18:35:16.397682 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:16.397686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:16.397755 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:16.397844 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:16.399259 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.400030 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.401524 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.402207 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.402335 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:16.406134 (+ 3799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:16.406144 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:16.406153 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:16.406200 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:16.409887 (+ 3687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:16.410650 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:16.410658 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:16.410664 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:16.410823 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:16.411233 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:16.411240 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:16.411246 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:16.411677 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:16.411834 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:16.412616 (+ 782us) server_negotiation.cc:299] Negotiation successful
0810 18:35:16.412876 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:35:16.414317 18296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:16.395016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:43663 (local address 127.13.139.2:56077)
0810 18:35:16.395774 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:16.395820 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:16.397434 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:16.398046 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:16.398053 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:16.398571 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:16.399112 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:16.399128 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.400163 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.400166 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:16.401362 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:16.401374 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.402421 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.402426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:16.402663 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:16.403360 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:16.403387 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:16.405904 (+ 2517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:16.410065 (+ 4161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:16.410071 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:16.410084 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:16.410526 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:16.410942 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:16.410945 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:16.410947 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:16.411124 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:16.411824 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:16.411834 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:16.412225 (+ 391us) client_negotiation.cc:769] Sending connection context
0810 18:35:16.412477 (+ 252us) client_negotiation.cc:240] Negotiation successful
0810 18:35:16.412846 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":267,"threads_started":1}
I20260810 18:35:16.415784 18293 heartbeater.cc:347] Connected to a master server at 127.13.139.62:43663
I20260810 18:35:16.416098 18293 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:16.416986 18293 heartbeater.cc:511] Master 127.13.139.62:43663 requested a full tablet report, sending...
I20260810 18:35:16.418815 17927 ts_manager.cc:194] Registered new tserver with Master: e099e4ea89ca4b4a8e671647bbe15904 (127.13.139.2:43649)
I20260810 18:35:16.419675 17927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:56077
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:35:16.455685 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:43663
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:16.778762 18299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:16.779155 18299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:16.779332 18299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:16.786684 18299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:16.786842 18299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:16.787043 18299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:16.797164 18299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:43663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:16.798519 18299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:16.799870 18299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:16.813542 18305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:16.813596 18306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:16.813501 18308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:16.819715 18299 server_base.cc:1034] running on GCE node
I20260810 18:35:16.820326 18299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:16.821298 18299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:16.822548 18299 hybrid_clock.cc:648] HybridClock initialized: now 1786386916822511 us; error 52 us; skew 500 ppm
I20260810 18:35:16.822877 18299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:16 dist-test-slave-5k54 krb5kdc[17874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:16.826444 18299 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:35:16.828016 18299 webserver.cc:460] Webserver started at http://127.13.139.3:46851/ using document root <none> and password file <none>
I20260810 18:35:16.828717 18299 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:16.828848 18299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:16.829191 18299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:16.832424 18299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "b93b9d376999430da1fbd1c6b769f962"
format_stamp: "Formatted at 2026-08-10 18:35:16 on dist-test-slave-5k54"
server_key: "665c1361e5ce41c0612ca09fd5b0d9be"
server_key_iv: "63b3b8c314a00e1bf95a1b8ec7c1923e"
server_key_version: "encryptionkey@0"
I20260810 18:35:16.833227 18299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "b93b9d376999430da1fbd1c6b769f962"
format_stamp: "Formatted at 2026-08-10 18:35:16 on dist-test-slave-5k54"
server_key: "665c1361e5ce41c0612ca09fd5b0d9be"
server_key_iv: "63b3b8c314a00e1bf95a1b8ec7c1923e"
server_key_version: "encryptionkey@0"
I20260810 18:35:16.838919 18299 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 18:35:16.842437 18316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:16.843876 18299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:16.844061 18299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "b93b9d376999430da1fbd1c6b769f962"
format_stamp: "Formatted at 2026-08-10 18:35:16 on dist-test-slave-5k54"
server_key: "665c1361e5ce41c0612ca09fd5b0d9be"
server_key_iv: "63b3b8c314a00e1bf95a1b8ec7c1923e"
server_key_version: "encryptionkey@0"
I20260810 18:35:16.844266 18299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:16.857712 18299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:16.862149 18299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:16.862449 18299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:16.863375 18299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:16.864792 18299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:16.864872 18299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:16.865046 18299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:16.865099 18299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:16.902496 18299 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:41345
I20260810 18:35:16.902585 18441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:41345 every 8 connection(s)
I20260810 18:35:16.903864 18299 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:16.906620 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 18299
I20260810 18:35:16.906824 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:16.907392 13868 external_mini_cluster.cc:1428] Setting key 4c76394bcfe46bea4b068ab5ff9af394
Aug 10 18:35:16 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:16.924304 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:16.906518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:41139 (local address 127.13.139.62:43663)
0810 18:35:16.906719 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:16.906727 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:16.908264 (+ 1537us) server_negotiation.cc:407] Connection header received
0810 18:35:16.910449 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:16.910452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:16.910542 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:16.910624 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:16.912186 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.912928 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.914359 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.914747 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.914973 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:16.918287 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:16.918291 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:16.918295 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:16.918325 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:16.920973 (+ 2648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:16.921873 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:16.921877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:16.921879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:16.922071 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:16.922596 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:16.922600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:16.922603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:16.922926 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:16.923103 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:16.923884 (+ 781us) server_negotiation.cc:299] Negotiation successful
0810 18:35:16.924048 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:35:16.925225 18444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:16.907189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:43663 (local address 127.13.139.3:41139)
0810 18:35:16.908026 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:16.908105 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:16.910133 (+ 2028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:16.910843 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:16.910851 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:16.911359 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:16.912042 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:16.912059 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.913052 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.913056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:16.914242 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:16.914254 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.914987 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.914992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:16.915231 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:16.915903 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:16.915923 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:16.918067 (+ 2144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:16.921124 (+ 3057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:16.921132 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:16.921168 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:16.921721 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:16.922217 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:16.922221 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:16.922223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:16.922457 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:16.923101 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:16.923109 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:16.923551 (+ 442us) client_negotiation.cc:769] Sending connection context
0810 18:35:16.923770 (+ 219us) client_negotiation.cc:240] Negotiation successful
0810 18:35:16.924140 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":371,"threads_started":1}
I20260810 18:35:16.926523 18442 heartbeater.cc:347] Connected to a master server at 127.13.139.62:43663
I20260810 18:35:16.926842 18442 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:16.927624 18442 heartbeater.cc:511] Master 127.13.139.62:43663 requested a full tablet report, sending...
I20260810 18:35:16.927686 18146 heartbeater.cc:503] Master 127.13.139.62:43663 was elected leader, sending a full tablet report...
I20260810 18:35:16.929256 17926 ts_manager.cc:194] Registered new tserver with Master: b93b9d376999430da1fbd1c6b769f962 (127.13.139.3:41345)
I20260810 18:35:16.930030 17926 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:41139
I20260810 18:35:16.935462 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 18:35:16 dist-test-slave-5k54 krb5kdc[17874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 18:35:16 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:16.991828 18449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:16.976417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56788 (local address 127.13.139.1:34075)
0810 18:35:16.977131 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:16.977138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:16.977166 (+ 28us) server_negotiation.cc:407] Connection header received
0810 18:35:16.977227 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:16.977233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:16.977462 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:16.977596 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:16.979018 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.980205 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.981394 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.982000 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:16.982109 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:16.986085 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:16.986096 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:16.986110 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:16.986149 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:16.989243 (+ 3094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:16.989842 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:16.989849 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:16.989851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:16.989992 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:16.990340 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:16.990343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:16.990345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:16.990685 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:16.990916 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:16.991155 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 18:35:16.991405 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":398,"threads_started":1}
Aug 10 18:35:17 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:17.010478 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:16.996453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48206 (local address 127.13.139.62:43663)
0810 18:35:16.996667 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:16.996673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:16.996784 (+ 111us) server_negotiation.cc:407] Connection header received
0810 18:35:16.996980 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:16.996986 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:16.997058 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:16.997163 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:16.998440 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:16.999202 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.000540 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:17.000967 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.001101 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:17.005109 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:17.005115 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:17.005118 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:17.005153 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:17.007774 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.008405 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.008412 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.008440 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.008581 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.008958 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.008965 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.008969 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.009322 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:17.009598 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:17.009893 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 18:35:17.010119 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260810 18:35:17.011106 17926 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48206
I20260810 18:35:17.012246 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17998
I20260810 18:35:17.025142 18449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:17.013325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56792 (local address 127.13.139.1:34075)
0810 18:35:17.013541 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:17.013547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:17.013691 (+ 144us) server_negotiation.cc:407] Connection header received
0810 18:35:17.013874 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:17.013881 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:17.013985 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:17.014090 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:17.015269 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:17.016035 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.017227 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:17.017663 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.017805 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:17.020049 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:17.020054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:17.020057 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:17.020089 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:17.022557 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.023194 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.023199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.023203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.023340 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.023732 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.023738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.023741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.024011 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:17.024266 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:17.024578 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 18:35:17.024824 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:35:17.025789 18139 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:17.108937 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 17998
I20260810 18:35:17.129129 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 18153
Aug 10 18:35:17 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:35:17.145324 18454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:17.130042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.13.139.2:43649)
0810 18:35:17.130566 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:17.130573 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:17.130598 (+ 25us) server_negotiation.cc:407] Connection header received
0810 18:35:17.130657 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:17.130663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:17.130883 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:17.131071 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:17.132395 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:17.133377 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.134670 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:17.135274 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.135412 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:17.139559 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:17.139570 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:17.139585 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:17.139618 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:17.142365 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.143031 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.143038 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.143041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.143207 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.143671 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.143678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.143682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.144023 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:17.144334 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:17.144700 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 18:35:17.144985 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":246,"threads_started":1}
I20260810 18:35:17.146585 18287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:17.229391 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 18153
I20260810 18:35:17.249102 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 18299
Aug 10 18:35:17 dist-test-slave-5k54 krb5kdc[17874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:35:17.265093 18456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:17.250220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56162 (local address 127.13.139.3:41345)
0810 18:35:17.250896 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:17.250903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:17.250932 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:35:17.250995 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:17.251002 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:17.251214 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:17.251342 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:17.252622 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:17.253647 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.254880 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:17.255416 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:17.255635 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:17.259860 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:17.259870 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:17.259884 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:17.259917 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:17.262594 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.263220 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.263226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.263229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.263361 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:17.263740 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:17.263743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:17.263745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:17.264077 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:17.264324 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:17.264572 (+ 248us) server_negotiation.cc:299] Negotiation successful
0810 18:35:17.264789 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":371,"threads_started":1}
I20260810 18:35:17.266400 18437 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:17.348896 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 18299
I20260810 18:35:17.367414 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 17892
I20260810 18:35:17.368669 17960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:17.472038 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 17892
2026-08-10T18:35:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4003 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:17 dist-test-slave-5k54 krb5kdc[18461](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:17 dist-test-slave-5k54 krb5kdc[18461](info): set up 2 sockets
Aug 10 18:35:17 dist-test-slave-5k54 krb5kdc[18461](info): commencing operation
krb5kdc: starting...
W20260810 18:35:18.630210 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:18 dist-test-slave-5k54 krb5kdc[18461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:18.863299 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44663
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:44663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:19.201452 18475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:19.201740 18475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:19.201830 18475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:19.209455 18475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:19.209651 18475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:19.209748 18475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:19.209841 18475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:19.209911 18475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:19.222465 18475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:44663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:19.223896 18475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:19.225214 18475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:19.236800 18481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:19.236868 18483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:19.236881 18480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:19.237624 18475 server_base.cc:1034] running on GCE node
I20260810 18:35:19.238431 18475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:19.239843 18475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:19.241044 18475 hybrid_clock.cc:648] HybridClock initialized: now 1786386919241010 us; error 25 us; skew 500 ppm
I20260810 18:35:19.241343 18475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:19 dist-test-slave-5k54 krb5kdc[18461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386919, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:19.244329 18475 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:19.245496 18475 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:19.245589 18475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:19.245857 18475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:19.248785 18475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "ce4e6cf9ff8942488f8acc954fd37385"
format_stamp: "Formatted at 2026-08-10 18:35:19 on dist-test-slave-5k54"
server_key: "7bba8729072d233f77992f15fe9a88d3"
server_key_iv: "6a637e4719772b29631bd69bb6b5e5ef"
server_key_version: "encryptionkey@0"
I20260810 18:35:19.249527 18475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "ce4e6cf9ff8942488f8acc954fd37385"
format_stamp: "Formatted at 2026-08-10 18:35:19 on dist-test-slave-5k54"
server_key: "7bba8729072d233f77992f15fe9a88d3"
server_key_iv: "6a637e4719772b29631bd69bb6b5e5ef"
server_key_version: "encryptionkey@0"
I20260810 18:35:19.254362 18475 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260810 18:35:19.257737 18490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:19.259146 18475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:35:19.259335 18475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "ce4e6cf9ff8942488f8acc954fd37385"
format_stamp: "Formatted at 2026-08-10 18:35:19 on dist-test-slave-5k54"
server_key: "7bba8729072d233f77992f15fe9a88d3"
server_key_iv: "6a637e4719772b29631bd69bb6b5e5ef"
server_key_version: "encryptionkey@0"
I20260810 18:35:19.259624 18475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:19.290810 18475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:19.294818 18475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:19.295083 18475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:19.313529 18475 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:44663
I20260810 18:35:19.313555 18551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:44663 every 8 connection(s)
I20260810 18:35:19.314466 18475 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:19.318053 18553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:19.319608 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 18475
I20260810 18:35:19.319842 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:19.320521 13868 external_mini_cluster.cc:1428] Setting key 5190ad032d0709155db3053fd4b0a2f9
I20260810 18:35:19.332527 18553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385: Bootstrap starting.
Aug 10 18:35:19 dist-test-slave-5k54 krb5kdc[18461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:19.335665 18553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:19.336892 18553 log.cc:824] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:19.340327 18553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385: No bootstrap required, opened a new log
I20260810 18:35:19.344810 18557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:19.322558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49842 (local address 127.13.139.62:44663)
0810 18:35:19.323412 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:19.323447 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:19.323497 (+ 50us) server_negotiation.cc:407] Connection header received
0810 18:35:19.325255 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:19.325284 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:19.325786 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:19.326206 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:19.327670 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:19.329763 (+ 2093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:19.331036 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:19.332100 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:19.332298 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:19.336305 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:19.336315 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:19.336333 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:19.336380 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:19.340226 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:19.340901 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:19.340910 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:19.340917 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:19.341140 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:19.341503 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:19.341509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:19.341512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:19.342226 (+ 714us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:19.342543 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:19.342950 (+ 407us) server_negotiation.cc:299] Negotiation successful
0810 18:35:19.343405 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":370,"threads_started":1}
I20260810 18:35:19.349790 18553 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce4e6cf9ff8942488f8acc954fd37385" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44663 } }
I20260810 18:35:19.350137 18553 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:19.350245 18553 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4e6cf9ff8942488f8acc954fd37385, State: Initialized, Role: FOLLOWER
I20260810 18:35:19.350844 18553 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce4e6cf9ff8942488f8acc954fd37385" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44663 } }
I20260810 18:35:19.351096 18553 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:19.351243 18553 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:19.351459 18553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:19.353586 18553 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce4e6cf9ff8942488f8acc954fd37385" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44663 } }
I20260810 18:35:19.354067 18553 leader_election.cc:302] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce4e6cf9ff8942488f8acc954fd37385; no voters:
I20260810 18:35:19.354655 18553 leader_election.cc:288] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:19.354786 18559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:19.355532 18559 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [term 1 LEADER]: Becoming Leader. State: Replica: ce4e6cf9ff8942488f8acc954fd37385, State: Running, Role: LEADER
I20260810 18:35:19.356063 18559 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce4e6cf9ff8942488f8acc954fd37385" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44663 } }
I20260810 18:35:19.356851 18553 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:19.358690 18560 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce4e6cf9ff8942488f8acc954fd37385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce4e6cf9ff8942488f8acc954fd37385" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44663 } } }
I20260810 18:35:19.359053 18560 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:19.360049 18564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:19.359884 18561 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce4e6cf9ff8942488f8acc954fd37385. Latest consensus state: current_term: 1 leader_uuid: "ce4e6cf9ff8942488f8acc954fd37385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce4e6cf9ff8942488f8acc954fd37385" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44663 } } }
I20260810 18:35:19.360214 18561 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:19.365505 18564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:19.374792 18564 catalog_manager.cc:1347] Generated new cluster ID: 7b6f708564ed4b60a15bb16753fc34b8
I20260810 18:35:19.374905 18564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:19.399382 18564 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:19.400733 18564 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:19.407696 18564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385: Generated new TSK 0
I20260810 18:35:19.408725 18564 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:35:19.464244 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44663
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:19.797672 18581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:19.797948 18581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:19.798118 18581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:19.806087 18581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:19.806236 18581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:19.806419 18581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:19.826293 18581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:19.828217 18581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:19.830462 18581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:19.847349 18587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:19.848121 18589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:19.847538 18586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:19.853363 18581 server_base.cc:1034] running on GCE node
I20260810 18:35:19.854244 18581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:19.855692 18581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:19.856966 18581 hybrid_clock.cc:648] HybridClock initialized: now 1786386919856899 us; error 50 us; skew 500 ppm
I20260810 18:35:19.857450 18581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:19 dist-test-slave-5k54 krb5kdc[18461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386919, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:19.862155 18581 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:35:19.863744 18581 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:19.863870 18581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:19.864238 18581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:19.867282 18581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "67309002e58346f99c4e98a974633825"
format_stamp: "Formatted at 2026-08-10 18:35:19 on dist-test-slave-5k54"
server_key: "8f424897a907b1bf0d922e611b32690b"
server_key_iv: "2ca14773659b1f0565cd996ecdba596e"
server_key_version: "encryptionkey@0"
I20260810 18:35:19.868278 18581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "67309002e58346f99c4e98a974633825"
format_stamp: "Formatted at 2026-08-10 18:35:19 on dist-test-slave-5k54"
server_key: "8f424897a907b1bf0d922e611b32690b"
server_key_iv: "2ca14773659b1f0565cd996ecdba596e"
server_key_version: "encryptionkey@0"
I20260810 18:35:19.873872 18581 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:35:19.877754 18596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:19.879244 18581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:19.879462 18581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "67309002e58346f99c4e98a974633825"
format_stamp: "Formatted at 2026-08-10 18:35:19 on dist-test-slave-5k54"
server_key: "8f424897a907b1bf0d922e611b32690b"
server_key_iv: "2ca14773659b1f0565cd996ecdba596e"
server_key_version: "encryptionkey@0"
I20260810 18:35:19.879693 18581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:19.896479 18581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:19.900938 18581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:19.901211 18581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:19.902257 18581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:19.903721 18581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:19.903855 18581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:19.903976 18581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:19.904066 18581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:19.941484 18581 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:41319
I20260810 18:35:19.941529 18718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:41319 every 8 connection(s)
I20260810 18:35:19.942335 18581 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:19.946249 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 18581
I20260810 18:35:19.946506 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:19.947465 13868 external_mini_cluster.cc:1428] Setting key a56862bd832d9b9527b8044b31184321
Aug 10 18:35:19 dist-test-slave-5k54 krb5kdc[18461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386919, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:19.969049 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:19.945034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:38517 (local address 127.13.139.62:44663)
0810 18:35:19.945572 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:19.945578 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:19.952197 (+ 6619us) server_negotiation.cc:407] Connection header received
0810 18:35:19.952274 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:19.952282 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:19.952377 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:19.952502 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:19.954651 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:19.956437 (+ 1786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:19.958594 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:19.959062 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:19.959199 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:19.962898 (+ 3699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:19.962904 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:19.962909 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:19.962951 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:19.965906 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:19.966627 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:19.966634 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:19.966637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:19.966765 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:19.967197 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:19.967203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:19.967207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:19.967554 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:19.967720 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:19.968435 (+ 715us) server_negotiation.cc:299] Negotiation successful
0810 18:35:19.968655 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":267,"threads_started":1}
I20260810 18:35:19.970165 18722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:19.945480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44663 (local address 127.13.139.1:38517)
0810 18:35:19.948772 (+ 3292us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:19.948854 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:19.951762 (+ 2908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:19.952786 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:19.952801 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:19.953627 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:19.954441 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:19.954469 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:19.956635 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:19.956643 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:19.958429 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:19.958444 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:19.959287 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:19.959296 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:19.959592 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:19.960347 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:19.960375 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:19.962685 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:19.966050 (+ 3365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:19.966059 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:19.966074 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:19.966506 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:19.966884 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:19.966888 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:19.966892 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:19.967083 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:19.967691 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:19.967698 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:19.968053 (+ 355us) client_negotiation.cc:769] Sending connection context
0810 18:35:19.968323 (+ 270us) client_negotiation.cc:240] Negotiation successful
0810 18:35:19.968857 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2929,"thread_start_us":2702,"threads_started":1}
I20260810 18:35:19.971792 18719 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44663
I20260810 18:35:19.972116 18719 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:19.972764 18719 heartbeater.cc:511] Master 127.13.139.62:44663 requested a full tablet report, sending...
I20260810 18:35:19.974848 18511 ts_manager.cc:194] Registered new tserver with Master: 67309002e58346f99c4e98a974633825 (127.13.139.1:41319)
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:35:19.976465 18511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:38517
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:35:20.013069 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44663
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:20.338486 18725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:20.338819 18725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:20.338994 18725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:20.346638 18725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:20.346789 18725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:20.346978 18725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:20.356693 18725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:20.358004 18725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:20.359375 18725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:20.372896 18730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:20.372865 18731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:20.373564 18733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:20.373981 18725 server_base.cc:1034] running on GCE node
I20260810 18:35:20.374605 18725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:20.376057 18725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:20.377276 18725 hybrid_clock.cc:648] HybridClock initialized: now 1786386920377216 us; error 52 us; skew 500 ppm
I20260810 18:35:20.377600 18725 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:20 dist-test-slave-5k54 krb5kdc[18461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386920, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:20.385653 18725 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:35:20.386847 18725 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:20.386971 18725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:20.387310 18725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:20.390298 18725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "fabad7829e3946d8917cf4e3ea96bfc8"
format_stamp: "Formatted at 2026-08-10 18:35:20 on dist-test-slave-5k54"
server_key: "e62c845f59ce20c38206636a8626f5b0"
server_key_iv: "ca33618c8df6390a4e614dea99c048af"
server_key_version: "encryptionkey@0"
I20260810 18:35:20.391120 18725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "fabad7829e3946d8917cf4e3ea96bfc8"
format_stamp: "Formatted at 2026-08-10 18:35:20 on dist-test-slave-5k54"
server_key: "e62c845f59ce20c38206636a8626f5b0"
server_key_iv: "ca33618c8df6390a4e614dea99c048af"
server_key_version: "encryptionkey@0"
I20260810 18:35:20.397053 18725 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:35:20.401216 18741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:20.402637 18725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:35:20.402880 18725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "fabad7829e3946d8917cf4e3ea96bfc8"
format_stamp: "Formatted at 2026-08-10 18:35:20 on dist-test-slave-5k54"
server_key: "e62c845f59ce20c38206636a8626f5b0"
server_key_iv: "ca33618c8df6390a4e614dea99c048af"
server_key_version: "encryptionkey@0"
I20260810 18:35:20.403126 18725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:20.418437 18725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:20.422662 18725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:20.422963 18725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:20.424047 18725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:20.425426 18725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:20.425550 18725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:20.425688 18725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:20.425782 18725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:20.460769 18725 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:43663
I20260810 18:35:20.460827 18864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:43663 every 8 connection(s)
I20260810 18:35:20.461670 18725 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:20.465432 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 18725
I20260810 18:35:20.465642 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:20.466214 13868 external_mini_cluster.cc:1428] Setting key cc06ae7573e40ae9a82c4940ac0cdf9a
Aug 10 18:35:20 dist-test-slave-5k54 krb5kdc[18461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386920, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:20.482369 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:20.464248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:42311 (local address 127.13.139.62:44663)
0810 18:35:20.464439 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:20.464444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:20.465732 (+ 1288us) server_negotiation.cc:407] Connection header received
0810 18:35:20.467859 (+ 2127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:20.467864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:20.467969 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:20.468078 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:20.469605 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.470320 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.472118 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.472568 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.472698 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:20.476260 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:20.476265 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:20.476268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:20.476303 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:20.479102 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:20.479971 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:20.479976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:20.479979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:20.480114 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:20.480575 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:20.480579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:20.480581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:20.480870 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:20.481049 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:20.481763 (+ 714us) server_negotiation.cc:299] Negotiation successful
0810 18:35:20.482013 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 18:35:20.483493 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:20.464738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44663 (local address 127.13.139.2:42311)
0810 18:35:20.465540 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:20.465593 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:20.467595 (+ 2002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:20.468317 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:20.468326 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:20.468855 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:20.469430 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:20.469447 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.470488 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.470492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:20.471972 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:20.471984 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.472812 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.472820 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:20.473039 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:20.473728 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:20.473756 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:20.476022 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:20.479264 (+ 3242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:20.479273 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:20.479300 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:20.479830 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:20.480232 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:20.480237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:20.480241 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:20.480436 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:20.481003 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:20.481013 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:20.481386 (+ 373us) client_negotiation.cc:769] Sending connection context
0810 18:35:20.481656 (+ 270us) client_negotiation.cc:240] Negotiation successful
0810 18:35:20.482209 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":337,"threads_started":1}
I20260810 18:35:20.485096 18865 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44663
I20260810 18:35:20.485427 18865 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:20.486104 18865 heartbeater.cc:511] Master 127.13.139.62:44663 requested a full tablet report, sending...
I20260810 18:35:20.487709 18511 ts_manager.cc:194] Registered new tserver with Master: fabad7829e3946d8917cf4e3ea96bfc8 (127.13.139.2:43663)
I20260810 18:35:20.488953 18511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:42311
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:35:20.520653 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44663
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:20.851158 18871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:20.851467 18871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:20.851673 18871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:20.859287 18871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:20.859449 18871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:20.859651 18871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:20.869781 18871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44663
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:20.871666 18871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:20.873562 18871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:20.888157 18876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:20.888185 18877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:20.888353 18879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:20.888952 18871 server_base.cc:1034] running on GCE node
I20260810 18:35:20.889573 18871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:20.890486 18871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:20.891708 18871 hybrid_clock.cc:648] HybridClock initialized: now 1786386920891662 us; error 57 us; skew 500 ppm
I20260810 18:35:20.892046 18871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:20 dist-test-slave-5k54 krb5kdc[18461](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386920, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:20.895243 18871 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:35:20.896384 18871 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:20.896519 18871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:20.896853 18871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:20.899782 18871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "bf59ce30c3eb4362953570a49ba49472"
format_stamp: "Formatted at 2026-08-10 18:35:20 on dist-test-slave-5k54"
server_key: "2552d09e49ce3c55a5aa3dc672dc1892"
server_key_iv: "3d955a6fa6319f7fe586097acb4845ca"
server_key_version: "encryptionkey@0"
I20260810 18:35:20.900717 18871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "bf59ce30c3eb4362953570a49ba49472"
format_stamp: "Formatted at 2026-08-10 18:35:20 on dist-test-slave-5k54"
server_key: "2552d09e49ce3c55a5aa3dc672dc1892"
server_key_iv: "3d955a6fa6319f7fe586097acb4845ca"
server_key_version: "encryptionkey@0"
I20260810 18:35:20.905823 18871 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:35:20.909560 18885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:20.910912 18871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:20.911092 18871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "bf59ce30c3eb4362953570a49ba49472"
format_stamp: "Formatted at 2026-08-10 18:35:20 on dist-test-slave-5k54"
server_key: "2552d09e49ce3c55a5aa3dc672dc1892"
server_key_iv: "3d955a6fa6319f7fe586097acb4845ca"
server_key_version: "encryptionkey@0"
I20260810 18:35:20.911326 18871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:20.933270 18871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:20.937634 18871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:20.937938 18871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:20.938885 18871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:20.940328 18871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:20.940457 18871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:20.940594 18871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:20.940685 18871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:20.975602 18871 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:45411
I20260810 18:35:20.975654 19007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:45411 every 8 connection(s)
I20260810 18:35:20.976498 18871 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:20.979470 18719 heartbeater.cc:503] Master 127.13.139.62:44663 was elected leader, sending a full tablet report...
I20260810 18:35:20.982991 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 18871
I20260810 18:35:20.983237 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:20.983861 13868 external_mini_cluster.cc:1428] Setting key 0f78fab463e4167f8f8017ec58f632b8
Aug 10 18:35:20 dist-test-slave-5k54 krb5kdc[18461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386920, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:20.997363 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:20.979028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:59843 (local address 127.13.139.62:44663)
0810 18:35:20.979235 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:20.979239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:20.980725 (+ 1486us) server_negotiation.cc:407] Connection header received
0810 18:35:20.982761 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:20.982769 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:20.982859 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:20.982978 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:20.984897 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.986026 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.988006 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.988428 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.988532 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:20.992036 (+ 3504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:20.992041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:20.992044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:20.992078 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:20.994552 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:20.995268 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:20.995271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:20.995274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:20.995392 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:20.995823 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:20.995826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:20.995828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:20.996118 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:20.996230 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:20.996926 (+ 696us) server_negotiation.cc:299] Negotiation successful
0810 18:35:20.997113 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 18:35:20.998495 19010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:20.979679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44663 (local address 127.13.139.3:59843)
0810 18:35:20.980541 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:20.980593 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:20.982496 (+ 1903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:20.983234 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:20.983242 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:20.983882 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:20.984659 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:20.984689 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.986245 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.986251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:20.987868 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:20.987882 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:20.988619 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:20.988624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:20.988821 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:20.989568 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:20.989592 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:20.991827 (+ 2235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:20.994682 (+ 2855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:20.994689 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:20.994701 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:20.995154 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:20.995541 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:20.995545 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:20.995547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:20.995719 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:20.996236 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:20.996242 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:20.996573 (+ 331us) client_negotiation.cc:769] Sending connection context
0810 18:35:20.996804 (+ 231us) client_negotiation.cc:240] Negotiation successful
0810 18:35:20.997209 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":332,"threads_started":1}
I20260810 18:35:21.000124 19008 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44663
I20260810 18:35:21.000444 19008 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:21.001121 19008 heartbeater.cc:511] Master 127.13.139.62:44663 requested a full tablet report, sending...
I20260810 18:35:21.002655 18509 ts_manager.cc:194] Registered new tserver with Master: bf59ce30c3eb4362953570a49ba49472 (127.13.139.3:45411)
I20260810 18:35:21.003634 18509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:59843
I20260810 18:35:21.012009 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:35:21.029197 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.016619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49858 (local address 127.13.139.62:44663)
0810 18:35:21.016791 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.016796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.017324 (+ 528us) server_negotiation.cc:407] Connection header received
0810 18:35:21.017525 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.017531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.017608 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.017711 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:21.019180 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.020058 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.021313 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.021743 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.021880 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.024113 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:21.024123 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:21.024127 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:21.024158 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:21.026572 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.027192 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.027199 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.027203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.027345 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.027749 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.027756 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.027761 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.028092 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:21.028362 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.028678 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.028890 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 18:35:21.033219 18509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:21.040273 18509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:21.074365 19025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.052869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:43663 (local address 127.0.0.1:49472)
0810 18:35:21.065369 (+ 12500us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:21.065392 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:21.065526 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:21.067552 (+ 2026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:21.067556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:21.067582 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:21.067962 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.067977 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.069914 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.069919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.071696 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.071708 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.073396 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.073402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.073602 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.073640 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 18:35:21.073783 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 18:35:21.073973 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12336,"thread_start_us":9750,"threads_started":1}
I20260810 18:35:21.074352 19029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.053438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49472 (local address 127.13.139.2:43663)
0810 18:35:21.066914 (+ 13476us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.066923 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.066963 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:35:21.067066 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.067073 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.067325 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.067563 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:21.068183 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.069770 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.071848 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.073191 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.073342 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.073553 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.073846 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.074013 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13314,"thread_start_us":13181,"threads_started":1}
I20260810 18:35:21.075065 19022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.051758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:41319 (local address 127.0.0.1:39456)
0810 18:35:21.052662 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:21.052702 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:21.052866 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:21.067046 (+ 14180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:21.067055 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:21.067085 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:21.067472 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.067491 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.069430 (+ 1939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.069436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.072020 (+ 2584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.072035 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.074195 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.074202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.074382 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.074415 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 18:35:21.074495 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 18:35:21.074631 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":1,"thread_start_us":321,"threads_started":1}
I20260810 18:35:21.075600 19026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.052269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:45411 (local address 127.0.0.1:43274)
0810 18:35:21.063380 (+ 11111us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:21.063407 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:21.063594 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:21.068035 (+ 4441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:21.068041 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:21.068066 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:21.068646 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.068658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.070455 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.070460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.072611 (+ 2151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.072629 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.074799 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.074807 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.074985 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.075026 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 18:35:21.075127 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 18:35:21.075264 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10504,"thread_start_us":12774,"threads_started":1}
I20260810 18:35:21.075892 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.052044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39456 (local address 127.13.139.1:41319)
0810 18:35:21.066033 (+ 13989us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.066044 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.066073 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:35:21.066201 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.066212 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.066512 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.066744 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:21.067690 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.069305 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.072217 (+ 2912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.073667 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.073806 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.074038 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.075272 (+ 1234us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.075478 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13786,"thread_start_us":14208,"threads_started":1}
I20260810 18:35:21.075953 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.053404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43274 (local address 127.13.139.3:45411)
0810 18:35:21.067402 (+ 13998us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.067408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.067481 (+ 73us) server_negotiation.cc:407] Connection header received
0810 18:35:21.067573 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.067580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.067812 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.068032 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:21.068873 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.070292 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.072800 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.074267 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.074386 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.074627 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.075416 (+ 789us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.075616 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13843,"thread_start_us":13697,"threads_started":1}
I20260810 18:35:21.078732 18789 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd940a68ce5453baf076755da900d2f (DEFAULT_TABLE table=test-table [id=6a8053467b5147d5b26f4f0143e41dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:21.079993 18789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd940a68ce5453baf076755da900d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:21.079792 18646 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd940a68ce5453baf076755da900d2f (DEFAULT_TABLE table=test-table [id=6a8053467b5147d5b26f4f0143e41dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:21.080157 18935 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd940a68ce5453baf076755da900d2f (DEFAULT_TABLE table=test-table [id=6a8053467b5147d5b26f4f0143e41dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:21.081234 18646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd940a68ce5453baf076755da900d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:21.081941 18935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd940a68ce5453baf076755da900d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:21.092185 19030 tablet_bootstrap.cc:492] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Bootstrap starting.
I20260810 18:35:21.095964 19030 tablet_bootstrap.cc:654] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:21.096306 19032 tablet_bootstrap.cc:492] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Bootstrap starting.
I20260810 18:35:21.097515 19030 log.cc:824] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:21.100211 19032 tablet_bootstrap.cc:654] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:21.101042 19030 tablet_bootstrap.cc:492] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: No bootstrap required, opened a new log
I20260810 18:35:21.101257 19031 tablet_bootstrap.cc:492] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Bootstrap starting.
I20260810 18:35:21.101331 19030 ts_tablet_manager.cc:1397] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.003s
I20260810 18:35:21.101506 19032 log.cc:824] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:21.104676 19031 tablet_bootstrap.cc:654] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:21.105682 19032 tablet_bootstrap.cc:492] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: No bootstrap required, opened a new log
I20260810 18:35:21.105676 19031 log.cc:824] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:21.105952 19032 ts_tablet_manager.cc:1397] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260810 18:35:21.108669 19031 tablet_bootstrap.cc:492] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: No bootstrap required, opened a new log
I20260810 18:35:21.108929 19031 ts_tablet_manager.cc:1397] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260810 18:35:21.111992 19030 raft_consensus.cc:348] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.112468 19030 raft_consensus.cc:374] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:21.112572 19030 raft_consensus.cc:729] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabad7829e3946d8917cf4e3ea96bfc8, State: Initialized, Role: FOLLOWER
I20260810 18:35:21.113219 19030 consensus_queue.cc:260] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.114694 18865 heartbeater.cc:503] Master 127.13.139.62:44663 was elected leader, sending a full tablet report...
I20260810 18:35:21.115118 19030 ts_tablet_manager.cc:1428] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260810 18:35:21.117692 19031 raft_consensus.cc:348] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.118119 19031 raft_consensus.cc:374] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:21.118224 19031 raft_consensus.cc:729] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67309002e58346f99c4e98a974633825, State: Initialized, Role: FOLLOWER
I20260810 18:35:21.118515 19032 raft_consensus.cc:348] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.118938 19032 raft_consensus.cc:374] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:21.118850 19031 consensus_queue.cc:260] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.119051 19032 raft_consensus.cc:729] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf59ce30c3eb4362953570a49ba49472, State: Initialized, Role: FOLLOWER
I20260810 18:35:21.119798 19032 consensus_queue.cc:260] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.121209 19031 ts_tablet_manager.cc:1428] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260810 18:35:21.122320 19008 heartbeater.cc:503] Master 127.13.139.62:44663 was elected leader, sending a full tablet report...
I20260810 18:35:21.122884 19032 ts_tablet_manager.cc:1428] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260810 18:35:21.182156 19038 raft_consensus.cc:482] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:21.182478 19038 raft_consensus.cc:504] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.184338 19038 leader_election.cc:288] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67309002e58346f99c4e98a974633825 (127.13.139.1:41319), fabad7829e3946d8917cf4e3ea96bfc8 (127.13.139.2:43663)
I20260810 18:35:21.190596 19010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.184618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:41319 (local address 127.13.139.3:38031)
0810 18:35:21.184842 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:21.184864 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:21.184985 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:21.185529 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:21.185534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:21.185573 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:21.185735 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.185743 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.186758 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.186765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.188831 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.188845 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.190062 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.190066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.190209 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.190232 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:35:21.190305 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 18:35:21.190397 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 18:35:21.190769 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.184696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:38031 (local address 127.13.139.1:41319)
0810 18:35:21.184890 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.184894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.184914 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:35:21.185192 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.185198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.185280 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.185385 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:21.185882 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.186612 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.188987 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.189917 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.190086 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.190160 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.190362 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.190514 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 18:35:21.191720 19029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.185190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:54179 (local address 127.13.139.2:43663)
0810 18:35:21.185413 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.185419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.185784 (+ 365us) server_negotiation.cc:407] Connection header received
0810 18:35:21.185940 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.185945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.186010 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.186106 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:21.186622 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.187532 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.189580 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.190800 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.190960 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.191054 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.191317 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.191470 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260810 18:35:21.191768 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.185015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:43663 (local address 127.13.139.3:54179)
0810 18:35:21.185670 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:21.185683 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:21.185824 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:21.186127 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:21.186132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:21.186157 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:21.186468 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.186477 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.187693 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.187698 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.189427 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:21.189438 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.190995 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.191001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:21.191156 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.191180 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 18:35:21.191288 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 18:35:21.191410 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":376,"threads_started":1}
I20260810 18:35:21.191679 18670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd940a68ce5453baf076755da900d2f" candidate_uuid: "bf59ce30c3eb4362953570a49ba49472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67309002e58346f99c4e98a974633825" is_pre_election: true
I20260810 18:35:21.192265 18670 raft_consensus.cc:2454] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf59ce30c3eb4362953570a49ba49472 in term 0.
I20260810 18:35:21.192670 18812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd940a68ce5453baf076755da900d2f" candidate_uuid: "bf59ce30c3eb4362953570a49ba49472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" is_pre_election: true
I20260810 18:35:21.192952 18886 leader_election.cc:302] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67309002e58346f99c4e98a974633825, bf59ce30c3eb4362953570a49ba49472; no voters:
I20260810 18:35:21.193226 18812 raft_consensus.cc:2454] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf59ce30c3eb4362953570a49ba49472 in term 0.
I20260810 18:35:21.193348 19038 raft_consensus.cc:2781] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:21.193522 19038 raft_consensus.cc:482] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:21.193643 19038 raft_consensus.cc:3037] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 0 FOLLOWER]: Advancing to term 1
W20260810 18:35:21.194736 18720 tablet.cc:2369] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:35:21.196349 19038 raft_consensus.cc:504] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.196842 19038 leader_election.cc:288] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [CANDIDATE]: Term 1 election: Requested vote from peers 67309002e58346f99c4e98a974633825 (127.13.139.1:41319), fabad7829e3946d8917cf4e3ea96bfc8 (127.13.139.2:43663)
I20260810 18:35:21.197254 18670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd940a68ce5453baf076755da900d2f" candidate_uuid: "bf59ce30c3eb4362953570a49ba49472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67309002e58346f99c4e98a974633825"
I20260810 18:35:21.197335 18812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd940a68ce5453baf076755da900d2f" candidate_uuid: "bf59ce30c3eb4362953570a49ba49472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fabad7829e3946d8917cf4e3ea96bfc8"
I20260810 18:35:21.197433 18670 raft_consensus.cc:3037] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:21.197567 18812 raft_consensus.cc:3037] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:21.199653 18670 raft_consensus.cc:2454] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf59ce30c3eb4362953570a49ba49472 in term 1.
I20260810 18:35:21.200026 18886 leader_election.cc:302] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67309002e58346f99c4e98a974633825, bf59ce30c3eb4362953570a49ba49472; no voters:
I20260810 18:35:21.200030 18812 raft_consensus.cc:2454] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf59ce30c3eb4362953570a49ba49472 in term 1.
I20260810 18:35:21.200289 19038 raft_consensus.cc:2781] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:21.200745 19038 raft_consensus.cc:686] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 1 LEADER]: Becoming Leader. State: Replica: bf59ce30c3eb4362953570a49ba49472, State: Running, Role: LEADER
I20260810 18:35:21.201227 19038 consensus_queue.cc:237] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } }
I20260810 18:35:21.205785 18511 catalog_manager.cc:5495] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf59ce30c3eb4362953570a49ba49472 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "bf59ce30c3eb4362953570a49ba49472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf59ce30c3eb4362953570a49ba49472" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45411 } health_report { overall_health: HEALTHY } } }
W20260810 18:35:21.213464 18867 tablet.cc:2369] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:35:21.228092 19009 tablet.cc:2369] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:35:21.229529 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.224086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43282 (local address 127.13.139.3:45411)
0810 18:35:21.224325 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.224333 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.224437 (+ 104us) server_negotiation.cc:407] Connection header received
0810 18:35:21.224628 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.224632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.224708 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.224841 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:21.225206 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.225912 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.227212 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.227668 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.227761 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.228418 (+ 657us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:21.228932 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:21.229060 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.229159 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.229227 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 18:35:21.237623 18670 raft_consensus.cc:1261] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 1 FOLLOWER]: Refusing update from remote peer bf59ce30c3eb4362953570a49ba49472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:21.237694 18812 raft_consensus.cc:1261] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 1 FOLLOWER]: Refusing update from remote peer bf59ce30c3eb4362953570a49ba49472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:21.238612 19040 consensus_queue.cc:1035] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67309002e58346f99c4e98a974633825" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:21.238968 19038 consensus_queue.cc:1035] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fabad7829e3946d8917cf4e3ea96bfc8" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:21.263548 18511 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:21.263839 18511 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:21.267309 18511 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce4e6cf9ff8942488f8acc954fd37385: Sending DeleteTablet for 3 replicas of tablet 1bd940a68ce5453baf076755da900d2f
I20260810 18:35:21.268846 18789 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd940a68ce5453baf076755da900d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:21 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:49472
I20260810 18:35:21.268874 18935 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd940a68ce5453baf076755da900d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:21 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:43274
I20260810 18:35:21.269593 18646 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd940a68ce5453baf076755da900d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:21 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:39456
I20260810 18:35:21.269765 19055 tablet_replica.cc:330] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: stopping tablet replica
I20260810 18:35:21.270179 19055 raft_consensus.cc:2229] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:21.270555 19057 tablet_replica.cc:330] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: stopping tablet replica
I20260810 18:35:21.270713 19055 raft_consensus.cc:2258] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:21.271088 19057 raft_consensus.cc:2229] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:21.271131 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 18581
I20260810 18:35:21.271584 19057 raft_consensus.cc:2258] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:21.274358 19057 ts_tablet_manager.cc:1905] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:21.280781 19055 ts_tablet_manager.cc:1905] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:21.282912 19057 ts_tablet_manager.cc:1918] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:21.283106 19057 log.cc:1196] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/1bd940a68ce5453baf076755da900d2f
I20260810 18:35:21.283771 19057 ts_tablet_manager.cc:1939] T 1bd940a68ce5453baf076755da900d2f P 67309002e58346f99c4e98a974633825: Deleting consensus metadata
I20260810 18:35:21.285717 18492 catalog_manager.cc:4841] TS 67309002e58346f99c4e98a974633825 (127.13.139.1:41319): tablet 1bd940a68ce5453baf076755da900d2f (table test-table [id=6a8053467b5147d5b26f4f0143e41dbd]) successfully deleted
I20260810 18:35:21.290140 19056 tablet_replica.cc:330] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: stopping tablet replica
I20260810 18:35:21.290601 19056 raft_consensus.cc:2229] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:21.291288 19056 raft_consensus.cc:2258] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:21.291996 19055 ts_tablet_manager.cc:1918] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:21.292243 19055 log.cc:1196] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/1bd940a68ce5453baf076755da900d2f
I20260810 18:35:21.292888 19055 ts_tablet_manager.cc:1939] T 1bd940a68ce5453baf076755da900d2f P fabad7829e3946d8917cf4e3ea96bfc8: Deleting consensus metadata
I20260810 18:35:21.293557 19056 ts_tablet_manager.cc:1905] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 18:35:21 dist-test-slave-5k54 krb5kdc[18461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:21.294961 18492 catalog_manager.cc:4841] TS fabad7829e3946d8917cf4e3ea96bfc8 (127.13.139.2:43663): tablet 1bd940a68ce5453baf076755da900d2f (table test-table [id=6a8053467b5147d5b26f4f0143e41dbd]) successfully deleted
I20260810 18:35:21.301054 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.272486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39462 (local address 127.13.139.1:41319)
0810 18:35:21.272660 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.272666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.283225 (+ 10559us) server_negotiation.cc:407] Connection header received
0810 18:35:21.283840 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.283849 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.283970 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.284048 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:21.285846 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.286985 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.288891 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.289534 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.289662 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.295103 (+ 5441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:21.295118 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:21.295134 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:21.295183 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:21.298162 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.298863 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.298870 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.298872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.299018 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.299407 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.299412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.299414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.299829 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:21.300157 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.300421 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.300654 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:35:21.301040 19056 ts_tablet_manager.cc:1918] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:21.301201 19056 log.cc:1196] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/1bd940a68ce5453baf076755da900d2f
I20260810 18:35:21.301772 18714 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:21.301782 19056 ts_tablet_manager.cc:1939] T 1bd940a68ce5453baf076755da900d2f P bf59ce30c3eb4362953570a49ba49472: Deleting consensus metadata
I20260810 18:35:21.303570 18494 catalog_manager.cc:4841] TS bf59ce30c3eb4362953570a49ba49472 (127.13.139.3:45411): tablet 1bd940a68ce5453baf076755da900d2f (table test-table [id=6a8053467b5147d5b26f4f0143e41dbd]) successfully deleted
I20260810 18:35:21.452247 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 18581
I20260810 18:35:21.475876 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 18725
Aug 10 18:35:21 dist-test-slave-5k54 krb5kdc[18461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:35:21.495929 19029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.477433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49474 (local address 127.13.139.2:43663)
0810 18:35:21.477643 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.477650 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.477671 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:35:21.477735 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.477741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.477844 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.477961 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:21.479534 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.480698 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.482522 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.483204 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.483328 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.488903 (+ 5575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:21.488916 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:21.488935 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:21.488981 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:21.492962 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.493797 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.493813 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.493816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.493990 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.494393 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.494396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.494398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.494748 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:21.495032 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.495363 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.495593 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:35:21.496636 18858 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:21.588769 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 18725
I20260810 18:35:21.608114 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 18871
Aug 10 18:35:21 dist-test-slave-5k54 krb5kdc[18461](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386918, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:35:21.625095 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:21.609166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43284 (local address 127.13.139.3:45411)
0810 18:35:21.609387 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:21.609405 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:21.609441 (+ 36us) server_negotiation.cc:407] Connection header received
0810 18:35:21.609518 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:21.609521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:21.609614 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:21.609729 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:21.611046 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.611930 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.613148 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:21.613610 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:21.613750 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:21.618759 (+ 5009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:21.618771 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:21.618786 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:21.618828 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:21.621986 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.622918 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.622926 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.622928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.623109 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:21.623611 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:21.623615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:21.623617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:21.623961 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:21.624211 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:21.624546 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 18:35:21.624707 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 18:35:21.625852 19003 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:21.749488 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 18871
I20260810 18:35:21.772266 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 18475
I20260810 18:35:21.773478 18547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:21.882253 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 18475
2026-08-10T18:35:21Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4408 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T18:35:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:21Z Disabled control of system clock
I20260810 18:35:21.956833 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33125
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:41095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:33125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 18:35:22.281028 19068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:22.281303 19068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:22.281471 19068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:22.288708 19068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:22.288815 19068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:22.288921 19068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:22.289026 19068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:22.289110 19068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:22.298424 19068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:33125
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:22.299777 19068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:22.301623 19068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:22.313508 19076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:22.313591 19074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:22.315707 19073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:22.316598 19068 server_base.cc:1034] running on GCE node
I20260810 18:35:22.317364 19068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:22.318702 19068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:22.319900 19068 hybrid_clock.cc:648] HybridClock initialized: now 1786386922319859 us; error 34 us; skew 500 ppm
I20260810 18:35:22.320262 19068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:22.322535 19068 webserver.cc:460] Webserver started at http://127.13.139.62:44045/ using document root <none> and password file <none>
I20260810 18:35:22.323223 19068 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:22.323343 19068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:22.323715 19068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:22.326632 19068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "df64b2cf7f424241b68cc17efb2f6164"
format_stamp: "Formatted at 2026-08-10 18:35:22 on dist-test-slave-5k54"
server_key: "484bdffa1bd81bb86bc5e08107c7059b"
server_key_iv: "381dee5c4cc2a46626c3d096252d3a0b"
server_key_version: "encryptionkey@0"
I20260810 18:35:22.327486 19068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "df64b2cf7f424241b68cc17efb2f6164"
format_stamp: "Formatted at 2026-08-10 18:35:22 on dist-test-slave-5k54"
server_key: "484bdffa1bd81bb86bc5e08107c7059b"
server_key_iv: "381dee5c4cc2a46626c3d096252d3a0b"
server_key_version: "encryptionkey@0"
I20260810 18:35:22.332476 19068 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260810 18:35:22.335819 19082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:22.337139 19068 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:35:22.337314 19068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "df64b2cf7f424241b68cc17efb2f6164"
format_stamp: "Formatted at 2026-08-10 18:35:22 on dist-test-slave-5k54"
server_key: "484bdffa1bd81bb86bc5e08107c7059b"
server_key_iv: "381dee5c4cc2a46626c3d096252d3a0b"
server_key_version: "encryptionkey@0"
I20260810 18:35:22.337530 19068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:22.343271 19068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:22.344046 19068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:22.344345 19068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:22.363051 19068 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:33125
I20260810 18:35:22.363087 19137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:33125 every 8 connection(s)
I20260810 18:35:22.364511 19068 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:22.366912 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19068
I20260810 18:35:22.367125 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:22.368005 13868 external_mini_cluster.cc:1428] Setting key 6261f5d031f2319241efcaab2ded2fb1
I20260810 18:35:22.368903 19138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:22.376813 19141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:22.370129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60556 (local address 127.13.139.62:33125)
0810 18:35:22.371152 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:22.371162 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:22.371203 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:35:22.373362 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:22.373382 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:22.373782 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:22.374110 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:22.375198 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:22.375207 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:22.375219 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:22.375232 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:22.375299 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:22.375317 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:22.375562 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:22.375667 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 18:35:22.375960 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":387,"threads_started":1}
I20260810 18:35:22.381618 19138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164: Bootstrap starting.
I20260810 18:35:22.384505 19138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:22.385555 19138 log.cc:824] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:22.388137 19138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164: No bootstrap required, opened a new log
I20260810 18:35:22.395054 19138 raft_consensus.cc:348] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df64b2cf7f424241b68cc17efb2f6164" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33125 } }
I20260810 18:35:22.395457 19138 raft_consensus.cc:374] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:22.395576 19138 raft_consensus.cc:729] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df64b2cf7f424241b68cc17efb2f6164, State: Initialized, Role: FOLLOWER
I20260810 18:35:22.396199 19138 consensus_queue.cc:260] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df64b2cf7f424241b68cc17efb2f6164" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33125 } }
I20260810 18:35:22.396450 19138 raft_consensus.cc:388] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:22.396600 19138 raft_consensus.cc:482] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:22.396780 19138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:22.398950 19138 raft_consensus.cc:504] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df64b2cf7f424241b68cc17efb2f6164" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33125 } }
I20260810 18:35:22.399520 19138 leader_election.cc:302] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df64b2cf7f424241b68cc17efb2f6164; no voters:
I20260810 18:35:22.400117 19138 leader_election.cc:288] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:22.400249 19143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:22.401021 19143 raft_consensus.cc:686] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [term 1 LEADER]: Becoming Leader. State: Replica: df64b2cf7f424241b68cc17efb2f6164, State: Running, Role: LEADER
I20260810 18:35:22.401607 19143 consensus_queue.cc:237] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df64b2cf7f424241b68cc17efb2f6164" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33125 } }
I20260810 18:35:22.402282 19138 sys_catalog.cc:564] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:22.405766 19145 sys_catalog.cc:455] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df64b2cf7f424241b68cc17efb2f6164. Latest consensus state: current_term: 1 leader_uuid: "df64b2cf7f424241b68cc17efb2f6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df64b2cf7f424241b68cc17efb2f6164" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33125 } } }
I20260810 18:35:22.405938 19144 sys_catalog.cc:455] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df64b2cf7f424241b68cc17efb2f6164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df64b2cf7f424241b68cc17efb2f6164" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33125 } } }
I20260810 18:35:22.406631 19145 sys_catalog.cc:458] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:22.406656 19144 sys_catalog.cc:458] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:22.413103 19151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:22.417309 19151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:22.425858 19151 catalog_manager.cc:1347] Generated new cluster ID: c45bc3ea1b7d43078e84096f606a510f
I20260810 18:35:22.425980 19151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:22.434243 19151 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:22.434670 19151 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:22.448750 19151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164: Generated new TSK 0
I20260810 18:35:22.449585 19151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:35:22.463269 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33125
--builtin_ntp_servers=127.13.139.20:41095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 18:35:22.790423 19164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:22.790742 19164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:22.790925 19164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:22.798101 19164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:22.798230 19164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:22.798404 19164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:22.807511 19164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:22.808775 19164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:22.810561 19164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:22.823547 19171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:22.823566 19173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:22.823792 19170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:22.824656 19164 server_base.cc:1034] running on GCE node
I20260810 18:35:22.825248 19164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:22.826192 19164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:22.827481 19164 hybrid_clock.cc:648] HybridClock initialized: now 1786386922827384 us; error 31 us; skew 500 ppm
I20260810 18:35:22.827837 19164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:22.830400 19164 webserver.cc:460] Webserver started at http://127.13.139.1:42441/ using document root <none> and password file <none>
I20260810 18:35:22.831167 19164 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:22.831302 19164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:22.831677 19164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:22.834591 19164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "10dd6f73b9c14f1b99f84a113b2e365d"
format_stamp: "Formatted at 2026-08-10 18:35:22 on dist-test-slave-5k54"
server_key: "d31f79cce48f6e70ab912189bf487a98"
server_key_iv: "f84a679bf88a364d6701d4c760d4edbb"
server_key_version: "encryptionkey@0"
I20260810 18:35:22.835407 19164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "10dd6f73b9c14f1b99f84a113b2e365d"
format_stamp: "Formatted at 2026-08-10 18:35:22 on dist-test-slave-5k54"
server_key: "d31f79cce48f6e70ab912189bf487a98"
server_key_iv: "f84a679bf88a364d6701d4c760d4edbb"
server_key_version: "encryptionkey@0"
I20260810 18:35:22.840586 19164 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260810 18:35:22.844375 19180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:22.845707 19164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:35:22.845876 19164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "10dd6f73b9c14f1b99f84a113b2e365d"
format_stamp: "Formatted at 2026-08-10 18:35:22 on dist-test-slave-5k54"
server_key: "d31f79cce48f6e70ab912189bf487a98"
server_key_iv: "f84a679bf88a364d6701d4c760d4edbb"
server_key_version: "encryptionkey@0"
I20260810 18:35:22.846058 19164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:22.851989 19164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:22.852736 19164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:22.852968 19164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:22.853793 19164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:22.855135 19164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:22.855221 19164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:22.855300 19164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:22.855355 19164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:22.895143 19164 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:38327
I20260810 18:35:22.895197 19303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:38327 every 8 connection(s)
I20260810 18:35:22.896543 19164 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:22.897220 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19164
I20260810 18:35:22.897439 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:22.898311 13868 external_mini_cluster.cc:1428] Setting key f93553e6cea5445a81bb0ba3956250b2
I20260810 18:35:22.901654 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33125
--builtin_ntp_servers=127.13.139.20:41095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 18:35:22.907361 19306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:22.899629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:48041 (local address 127.13.139.62:33125)
0810 18:35:22.900104 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:22.900110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:22.901668 (+ 1558us) server_negotiation.cc:407] Connection header received
0810 18:35:22.904592 (+ 2924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:22.904596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:22.904654 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:22.904759 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:22.906421 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:22.906426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:22.906429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:22.906446 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:22.906490 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:22.906502 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:22.906600 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:22.906964 (+ 364us) server_negotiation.cc:299] Negotiation successful
0810 18:35:22.907039 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":240,"threads_started":1}
I20260810 18:35:22.908489 19307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:22.900357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33125 (local address 127.13.139.1:48041)
0810 18:35:22.901493 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:22.901552 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:22.904196 (+ 2644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:22.905060 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:22.905077 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:22.905214 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:22.906047 (+ 833us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:22.906052 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:22.906107 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:22.906228 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:22.906605 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:22.906618 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:22.906628 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 18:35:22.906916 (+ 288us) client_negotiation.cc:240] Negotiation successful
0810 18:35:22.907195 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":302,"threads_started":1}
I20260810 18:35:22.910151 19304 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33125
I20260810 18:35:22.910521 19304 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:22.911281 19304 heartbeater.cc:511] Master 127.13.139.62:33125 requested a full tablet report, sending...
I20260810 18:35:22.913535 19100 ts_manager.cc:194] Registered new tserver with Master: 10dd6f73b9c14f1b99f84a113b2e365d (127.13.139.1:38327)
W20260810 18:35:23.244745 19308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:23.245095 19308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:23.245261 19308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:23.252790 19308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:23.252948 19308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:23.253129 19308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:23.263234 19308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:23.264621 19308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:23.266453 19308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:23.279366 19313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:23.279457 19317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:23.279475 19314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:23.281111 19308 server_base.cc:1034] running on GCE node
I20260810 18:35:23.281697 19308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:23.282620 19308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:23.283846 19308 hybrid_clock.cc:648] HybridClock initialized: now 1786386923283805 us; error 52 us; skew 500 ppm
I20260810 18:35:23.284180 19308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:23.286449 19308 webserver.cc:460] Webserver started at http://127.13.139.2:40363/ using document root <none> and password file <none>
I20260810 18:35:23.287142 19308 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:23.287271 19308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:23.287660 19308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:23.290433 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf"
format_stamp: "Formatted at 2026-08-10 18:35:23 on dist-test-slave-5k54"
server_key: "cc739365c9cfad1ebf4bfe662807b5e9"
server_key_iv: "3115f2ff69e606a7141bde60d8b07391"
server_key_version: "encryptionkey@0"
I20260810 18:35:23.291224 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf"
format_stamp: "Formatted at 2026-08-10 18:35:23 on dist-test-slave-5k54"
server_key: "cc739365c9cfad1ebf4bfe662807b5e9"
server_key_iv: "3115f2ff69e606a7141bde60d8b07391"
server_key_version: "encryptionkey@0"
I20260810 18:35:23.296154 19308 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 18:35:23.299791 19324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:23.301066 19308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:35:23.301239 19308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf"
format_stamp: "Formatted at 2026-08-10 18:35:23 on dist-test-slave-5k54"
server_key: "cc739365c9cfad1ebf4bfe662807b5e9"
server_key_iv: "3115f2ff69e606a7141bde60d8b07391"
server_key_version: "encryptionkey@0"
I20260810 18:35:23.301465 19308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:23.307257 19308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:23.308055 19308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:23.308328 19308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:23.309242 19308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:23.310786 19308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:23.310910 19308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:23.311044 19308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:23.311132 19308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:23.344830 19308 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:41209
I20260810 18:35:23.344923 19447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:41209 every 8 connection(s)
I20260810 18:35:23.346197 19308 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:23.346879 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19308
I20260810 18:35:23.347079 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:23.347872 13868 external_mini_cluster.cc:1428] Setting key e659b94fe3e587349561d44c022d9fc3
I20260810 18:35:23.351097 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33125
--builtin_ntp_servers=127.13.139.20:41095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 18:35:23.355654 19306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.349510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:33133 (local address 127.13.139.62:33125)
0810 18:35:23.349717 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:23.349724 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:23.351538 (+ 1814us) server_negotiation.cc:407] Connection header received
0810 18:35:23.353265 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:23.353271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:23.353353 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:23.353483 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:23.354831 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:23.354836 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:23.354841 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:23.354859 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:23.354900 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:23.354913 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:23.355048 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:23.355263 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 18:35:23.355332 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:35:23.356555 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.350260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33125 (local address 127.13.139.2:33133)
0810 18:35:23.351371 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:23.351447 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:23.352996 (+ 1549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:23.353711 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:23.353718 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:23.353807 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:23.354542 (+ 735us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:23.354545 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:23.354581 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:23.354664 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:23.355022 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:23.355033 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:23.355049 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 18:35:23.355331 (+ 282us) client_negotiation.cc:240] Negotiation successful
0810 18:35:23.355614 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":309,"threads_started":1}
I20260810 18:35:23.357896 19448 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33125
I20260810 18:35:23.358189 19448 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:23.358901 19448 heartbeater.cc:511] Master 127.13.139.62:33125 requested a full tablet report, sending...
I20260810 18:35:23.360492 19100 ts_manager.cc:194] Registered new tserver with Master: c6534a7a8f6c47acb9f63ec3faef9ebf (127.13.139.2:41209)
W20260810 18:35:23.682354 19452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:23.682641 19452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:23.682730 19452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:23.689978 19452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:23.690073 19452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:23.690263 19452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:23.698936 19452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33125
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:23.700212 19452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:23.702061 19452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:23.715631 19458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:23.715607 19459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:23.715734 19461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:23.720844 19452 server_base.cc:1034] running on GCE node
I20260810 18:35:23.721453 19452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:23.722369 19452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:23.723557 19452 hybrid_clock.cc:648] HybridClock initialized: now 1786386923723519 us; error 29 us; skew 500 ppm
I20260810 18:35:23.723891 19452 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:23.726110 19452 webserver.cc:460] Webserver started at http://127.13.139.3:42349/ using document root <none> and password file <none>
I20260810 18:35:23.726804 19452 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:23.726918 19452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:23.727263 19452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:23.730120 19452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "ef0c7db1da47449c981bb5690b9ba98b"
format_stamp: "Formatted at 2026-08-10 18:35:23 on dist-test-slave-5k54"
server_key: "dd33df924b6c4d71c45675579328147e"
server_key_iv: "f5dcfd007efde8db7b7237206cbef24a"
server_key_version: "encryptionkey@0"
I20260810 18:35:23.730922 19452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "ef0c7db1da47449c981bb5690b9ba98b"
format_stamp: "Formatted at 2026-08-10 18:35:23 on dist-test-slave-5k54"
server_key: "dd33df924b6c4d71c45675579328147e"
server_key_iv: "f5dcfd007efde8db7b7237206cbef24a"
server_key_version: "encryptionkey@0"
I20260810 18:35:23.736052 19452 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260810 18:35:23.739519 19467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:23.740811 19452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:35:23.741005 19452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "ef0c7db1da47449c981bb5690b9ba98b"
format_stamp: "Formatted at 2026-08-10 18:35:23 on dist-test-slave-5k54"
server_key: "dd33df924b6c4d71c45675579328147e"
server_key_iv: "f5dcfd007efde8db7b7237206cbef24a"
server_key_version: "encryptionkey@0"
I20260810 18:35:23.741225 19452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:23.746760 19452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:23.747566 19452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:23.747825 19452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:23.748842 19452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:23.750336 19452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:23.750447 19452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:23.750560 19452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:23.750638 19452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:23.783603 19452 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:36831
I20260810 18:35:23.783694 19592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:36831 every 8 connection(s)
I20260810 18:35:23.784981 19452 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:23.793258 19306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.787612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:51561 (local address 127.13.139.62:33125)
0810 18:35:23.787793 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:23.787798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:23.789236 (+ 1438us) server_negotiation.cc:407] Connection header received
0810 18:35:23.790931 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:23.790936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:23.791032 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:23.791167 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:23.792527 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:23.792531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:23.792535 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:23.792550 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:23.792579 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:23.792592 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:23.792724 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:23.792912 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 18:35:23.792983 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:35:23.794201 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.788156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33125 (local address 127.13.139.3:51561)
0810 18:35:23.789077 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:23.789119 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:23.790667 (+ 1548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:23.791381 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:23.791388 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:23.791539 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:23.792221 (+ 682us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:23.792224 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:23.792260 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:23.792344 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:23.792687 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:23.792700 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:23.792709 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 18:35:23.793004 (+ 295us) client_negotiation.cc:240] Negotiation successful
0810 18:35:23.793253 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":287,"threads_started":1}
I20260810 18:35:23.795207 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19452
I20260810 18:35:23.795387 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:23.795838 19593 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33125
I20260810 18:35:23.796010 13868 external_mini_cluster.cc:1428] Setting key f719f5b86146675bee7c5f7db9023e54
I20260810 18:35:23.796185 19593 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:23.796885 19593 heartbeater.cc:511] Master 127.13.139.62:33125 requested a full tablet report, sending...
I20260810 18:35:23.798504 19099 ts_manager.cc:194] Registered new tserver with Master: ef0c7db1da47449c981bb5690b9ba98b (127.13.139.3:36831)
I20260810 18:35:23.811281 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:35:23.818328 19306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.816026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60572 (local address 127.13.139.62:33125)
0810 18:35:23.816190 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:23.816196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:23.816777 (+ 581us) server_negotiation.cc:407] Connection header received
0810 18:35:23.816915 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:23.816918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:23.816968 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:23.817052 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:23.817892 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:23.817896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:23.817899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:23.817913 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:23.817946 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:23.817958 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:23.818051 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:23.818082 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 18:35:23.818126 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:35:23.822227 19099 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:23.829099 19099 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:23.858112 19610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.840954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:41209 (local address 127.0.0.1:43886)
0810 18:35:23.852411 (+ 11457us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:23.852468 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:23.852600 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:23.854008 (+ 1408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:23.854016 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:23.854146 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:23.855170 (+ 1024us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:23.855176 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:23.855216 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:23.855331 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:23.857317 (+ 1986us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:23.857327 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:23.857335 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 18:35:23.857505 (+ 170us) client_negotiation.cc:240] Negotiation successful
0810 18:35:23.857590 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11215,"thread_start_us":11893,"threads_started":1}
I20260810 18:35:23.859031 19611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.841297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43886 (local address 127.13.139.2:41209)
0810 18:35:23.853488 (+ 12191us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:23.853494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:23.853518 (+ 24us) server_negotiation.cc:407] Connection header received
0810 18:35:23.853574 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:23.853580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:23.853770 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:23.854834 (+ 1064us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:23.856721 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:23.856734 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:23.856754 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:23.856791 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:23.856850 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:23.856874 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:23.858508 (+ 1634us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:23.858592 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 18:35:23.858686 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12034,"thread_start_us":11903,"threads_started":1}
I20260810 18:35:23.859280 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.841542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34154 (local address 127.13.139.3:36831)
0810 18:35:23.852819 (+ 11277us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:23.852832 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:23.853374 (+ 542us) server_negotiation.cc:407] Connection header received
0810 18:35:23.853485 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:23.853494 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:23.853737 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:23.853920 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:23.857234 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:23.857244 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:23.857259 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:23.857280 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:23.857342 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:23.857363 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:23.857552 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:23.858488 (+ 936us) server_negotiation.cc:299] Negotiation successful
0810 18:35:23.858602 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11039,"thread_start_us":11292,"threads_started":1}
I20260810 18:35:23.858335 19609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.841161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:36831 (local address 127.0.0.1:34154)
0810 18:35:23.853127 (+ 11966us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:23.853147 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:23.853247 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:23.855126 (+ 1879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:23.855134 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:23.855166 (+ 32us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:23.856980 (+ 1814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:23.856983 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:23.857001 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:23.857045 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:23.857608 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:23.857613 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:23.857618 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 18:35:23.857777 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 18:35:23.857828 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11833,"thread_start_us":10868,"threads_started":1}
I20260810 18:35:23.860903 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.853937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:60164)
0810 18:35:23.857515 (+ 3578us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:23.857533 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:23.857623 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:23.858244 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:23.858251 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:23.858282 (+ 31us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:23.859007 (+ 725us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:23.859012 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:23.859030 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:23.859075 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:23.860288 (+ 1213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:23.860293 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:23.860298 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 18:35:23.860413 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 18:35:23.860464 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3453,"thread_start_us":3314,"threads_started":1}
I20260810 18:35:23.861657 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:23.853599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60164 (local address 127.13.139.1:38327)
0810 18:35:23.857227 (+ 3628us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:23.857237 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:23.857739 (+ 502us) server_negotiation.cc:407] Connection header received
0810 18:35:23.857815 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:23.857822 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:23.858046 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:23.858724 (+ 678us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:23.860052 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:23.860058 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:23.860070 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:23.860094 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:23.860140 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:23.860156 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:23.861143 (+ 987us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:23.861217 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 18:35:23.861313 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3453,"thread_start_us":3340,"threads_started":1}
I20260810 18:35:23.863075 19521 tablet_service.cc:1467] Processing CreateTablet for tablet 045049f321614710b5e393322eaea808 (DEFAULT_TABLE table=test-table [id=a25d9181d3854eedb44a0c44748204c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:23.863018 19379 tablet_service.cc:1467] Processing CreateTablet for tablet 045049f321614710b5e393322eaea808 (DEFAULT_TABLE table=test-table [id=a25d9181d3854eedb44a0c44748204c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:23.864485 19379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 045049f321614710b5e393322eaea808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:23.864499 19521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 045049f321614710b5e393322eaea808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:23.865007 19232 tablet_service.cc:1467] Processing CreateTablet for tablet 045049f321614710b5e393322eaea808 (DEFAULT_TABLE table=test-table [id=a25d9181d3854eedb44a0c44748204c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:23.866271 19232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 045049f321614710b5e393322eaea808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:23.876291 19615 tablet_bootstrap.cc:492] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Bootstrap starting.
I20260810 18:35:23.879078 19616 tablet_bootstrap.cc:492] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Bootstrap starting.
I20260810 18:35:23.881031 19615 tablet_bootstrap.cc:654] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:23.881215 19617 tablet_bootstrap.cc:492] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: Bootstrap starting.
I20260810 18:35:23.882136 19615 log.cc:824] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:23.882690 19616 tablet_bootstrap.cc:654] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:23.884028 19616 log.cc:824] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:23.884759 19617 tablet_bootstrap.cc:654] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:23.885303 19615 tablet_bootstrap.cc:492] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: No bootstrap required, opened a new log
I20260810 18:35:23.885601 19615 ts_tablet_manager.cc:1397] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260810 18:35:23.885823 19617 log.cc:824] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:23.887143 19616 tablet_bootstrap.cc:492] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: No bootstrap required, opened a new log
I20260810 18:35:23.887404 19616 ts_tablet_manager.cc:1397] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:35:23.888824 19617 tablet_bootstrap.cc:492] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: No bootstrap required, opened a new log
I20260810 18:35:23.889081 19617 ts_tablet_manager.cc:1397] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:35:23.896299 19615 raft_consensus.cc:348] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:23.896765 19615 raft_consensus.cc:374] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:23.896557 19617 raft_consensus.cc:348] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:23.896860 19615 raft_consensus.cc:729] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0c7db1da47449c981bb5690b9ba98b, State: Initialized, Role: FOLLOWER
I20260810 18:35:23.897012 19617 raft_consensus.cc:374] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:23.897120 19617 raft_consensus.cc:729] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dd6f73b9c14f1b99f84a113b2e365d, State: Initialized, Role: FOLLOWER
I20260810 18:35:23.897576 19615 consensus_queue.cc:260] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:23.897743 19617 consensus_queue.cc:260] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:23.897943 19616 raft_consensus.cc:348] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:23.898442 19616 raft_consensus.cc:374] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:23.898566 19616 raft_consensus.cc:729] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6534a7a8f6c47acb9f63ec3faef9ebf, State: Initialized, Role: FOLLOWER
I20260810 18:35:23.899528 19616 consensus_queue.cc:260] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:23.908439 19616 ts_tablet_manager.cc:1428] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Time spent starting tablet: real 0.021s user 0.013s sys 0.006s
I20260810 18:35:23.908947 19448 heartbeater.cc:503] Master 127.13.139.62:33125 was elected leader, sending a full tablet report...
I20260810 18:35:23.916702 19304 heartbeater.cc:503] Master 127.13.139.62:33125 was elected leader, sending a full tablet report...
I20260810 18:35:23.918313 19593 heartbeater.cc:503] Master 127.13.139.62:33125 was elected leader, sending a full tablet report...
I20260810 18:35:23.918558 19615 ts_tablet_manager.cc:1428] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Time spent starting tablet: real 0.033s user 0.019s sys 0.015s
I20260810 18:35:23.919495 19617 ts_tablet_manager.cc:1428] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: Time spent starting tablet: real 0.030s user 0.009s sys 0.019s
I20260810 18:35:24.006220 19623 raft_consensus.cc:482] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:24.006599 19623 raft_consensus.cc:504] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:24.008366 19623 leader_election.cc:288] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6534a7a8f6c47acb9f63ec3faef9ebf (127.13.139.2:41209), ef0c7db1da47449c981bb5690b9ba98b (127.13.139.3:36831)
I20260810 18:35:24.011806 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.008887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:46443 (local address 127.13.139.3:36831)
0810 18:35:24.009089 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:24.009096 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:24.009653 (+ 557us) server_negotiation.cc:407] Connection header received
0810 18:35:24.009870 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:24.009875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:24.009936 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:24.010054 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:24.011149 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:24.011154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:24.011158 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:24.011177 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:24.011216 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:24.011231 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:24.011361 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:24.011470 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 18:35:24.011533 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 18:35:24.011806 19611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.008768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:39317 (local address 127.13.139.2:41209)
0810 18:35:24.008983 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:24.008990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:24.010016 (+ 1026us) server_negotiation.cc:407] Connection header received
0810 18:35:24.010161 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:24.010168 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:24.010232 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:24.010306 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:24.011163 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:24.011170 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:24.011174 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:24.011190 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:24.011221 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:24.011236 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:24.011353 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:24.011496 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 18:35:24.011553 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 18:35:24.012145 19626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.009094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:41209 (local address 127.13.139.1:39317)
0810 18:35:24.009895 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.009909 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:24.010033 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:24.010368 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:24.010374 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:24.010401 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:24.010974 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:24.010977 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:24.010989 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:24.011026 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:24.011339 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:24.011344 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:24.011349 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 18:35:24.011522 (+ 173us) client_negotiation.cc:240] Negotiation successful
0810 18:35:24.011588 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"thread_start_us":505,"threads_started":1}
I20260810 18:35:24.012166 19625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.008679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:36831 (local address 127.13.139.1:46443)
0810 18:35:24.009523 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.009544 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:24.009726 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:24.010106 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:24.010111 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:24.010136 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:24.010876 (+ 740us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:35:24.010881 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:24.010903 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:35:24.010964 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:24.011339 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:24.011344 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:24.011349 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 18:35:24.011567 (+ 218us) client_negotiation.cc:240] Negotiation successful
0810 18:35:24.011603 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":734,"threads_started":1}
I20260810 18:35:24.013317 19399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "045049f321614710b5e393322eaea808" candidate_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" is_pre_election: true
I20260810 18:35:24.013317 19543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "045049f321614710b5e393322eaea808" candidate_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0c7db1da47449c981bb5690b9ba98b" is_pre_election: true
I20260810 18:35:24.013919 19543 raft_consensus.cc:2454] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dd6f73b9c14f1b99f84a113b2e365d in term 0.
I20260810 18:35:24.013921 19399 raft_consensus.cc:2454] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10dd6f73b9c14f1b99f84a113b2e365d in term 0.
I20260810 18:35:24.014678 19183 leader_election.cc:302] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dd6f73b9c14f1b99f84a113b2e365d, c6534a7a8f6c47acb9f63ec3faef9ebf; no voters:
I20260810 18:35:24.015098 19623 raft_consensus.cc:2781] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:24.015247 19623 raft_consensus.cc:482] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:24.015352 19623 raft_consensus.cc:3037] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:24.017531 19623 raft_consensus.cc:504] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:24.018127 19623 leader_election.cc:288] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [CANDIDATE]: Term 1 election: Requested vote from peers c6534a7a8f6c47acb9f63ec3faef9ebf (127.13.139.2:41209), ef0c7db1da47449c981bb5690b9ba98b (127.13.139.3:36831)
I20260810 18:35:24.018507 19399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "045049f321614710b5e393322eaea808" candidate_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf"
I20260810 18:35:24.018721 19399 raft_consensus.cc:3037] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:24.018708 19543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "045049f321614710b5e393322eaea808" candidate_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0c7db1da47449c981bb5690b9ba98b"
I20260810 18:35:24.018918 19543 raft_consensus.cc:3037] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:24.021250 19399 raft_consensus.cc:2454] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dd6f73b9c14f1b99f84a113b2e365d in term 1.
I20260810 18:35:24.021252 19543 raft_consensus.cc:2454] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10dd6f73b9c14f1b99f84a113b2e365d in term 1.
I20260810 18:35:24.021672 19185 leader_election.cc:302] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10dd6f73b9c14f1b99f84a113b2e365d, ef0c7db1da47449c981bb5690b9ba98b; no voters:
I20260810 18:35:24.021963 19623 raft_consensus.cc:2781] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:24.022401 19623 raft_consensus.cc:686] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 1 LEADER]: Becoming Leader. State: Replica: 10dd6f73b9c14f1b99f84a113b2e365d, State: Running, Role: LEADER
I20260810 18:35:24.022953 19623 consensus_queue.cc:237] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } }
I20260810 18:35:24.027642 19099 catalog_manager.cc:5495] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d reported cstate change: term changed from 0 to 1, leader changed from <none> to 10dd6f73b9c14f1b99f84a113b2e365d (127.13.139.1). New cstate: current_term: 1 leader_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10dd6f73b9c14f1b99f84a113b2e365d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 38327 } health_report { overall_health: HEALTHY } } }
W20260810 18:35:24.036705 19595 tablet.cc:2369] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:35:24.061205 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.058727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60176 (local address 127.13.139.1:38327)
0810 18:35:24.058920 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:24.058926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:24.059102 (+ 176us) server_negotiation.cc:407] Connection header received
0810 18:35:24.059347 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:24.059351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:24.059481 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:24.059596 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:24.060534 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:24.060540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:24.060544 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:24.060565 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:24.060621 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:24.060633 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:24.060772 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:24.060861 (+ 89us) server_negotiation.cc:299] Negotiation successful
0810 18:35:24.060923 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:35:24.069872 19543 raft_consensus.cc:1261] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 1 FOLLOWER]: Refusing update from remote peer 10dd6f73b9c14f1b99f84a113b2e365d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:24.070084 19399 raft_consensus.cc:1261] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 1 FOLLOWER]: Refusing update from remote peer 10dd6f73b9c14f1b99f84a113b2e365d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:24.070974 19627 consensus_queue.cc:1035] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0c7db1da47449c981bb5690b9ba98b" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:24.071349 19623 consensus_queue.cc:1035] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6534a7a8f6c47acb9f63ec3faef9ebf" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:24.118613 19099 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:24.118909 19099 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:24.122552 19099 catalog_manager.cc:5782] T 00000000000000000000000000000000 P df64b2cf7f424241b68cc17efb2f6164: Sending DeleteTablet for 3 replicas of tablet 045049f321614710b5e393322eaea808
I20260810 18:35:24.123939 19379 tablet_service.cc:1514] Processing DeleteTablet for tablet 045049f321614710b5e393322eaea808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:24 UTC) from {username='slave'} at 127.0.0.1:43886
I20260810 18:35:24.124401 19521 tablet_service.cc:1514] Processing DeleteTablet for tablet 045049f321614710b5e393322eaea808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:24 UTC) from {username='slave'} at 127.0.0.1:34154
I20260810 18:35:24.124755 19232 tablet_service.cc:1514] Processing DeleteTablet for tablet 045049f321614710b5e393322eaea808 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:24 UTC) from {username='slave'} at 127.0.0.1:60164
I20260810 18:35:24.127748 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19164
I20260810 18:35:24.133824 19642 tablet_replica.cc:330] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: stopping tablet replica
I20260810 18:35:24.134413 19642 raft_consensus.cc:2229] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:24.135255 19642 raft_consensus.cc:2258] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:24.136831 19640 tablet_replica.cc:330] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: stopping tablet replica
I20260810 18:35:24.137296 19640 raft_consensus.cc:2229] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:24.137854 19640 raft_consensus.cc:2258] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:24.140595 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.129144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60182 (local address 127.13.139.1:38327)
0810 18:35:24.129362 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:24.129371 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:24.137243 (+ 7872us) server_negotiation.cc:407] Connection header received
0810 18:35:24.137632 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:24.137637 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:24.137709 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:24.137786 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:24.139600 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:24.139609 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:24.139618 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:24.139649 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:24.139698 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:24.139719 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:24.139849 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:24.140158 (+ 309us) server_negotiation.cc:299] Negotiation successful
0810 18:35:24.140241 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:35:24.142488 19299 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:24.142539 19641 tablet_replica.cc:330] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: stopping tablet replica
I20260810 18:35:24.143006 19641 raft_consensus.cc:2229] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:24.143543 19641 raft_consensus.cc:2258] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:24.144620 19640 ts_tablet_manager.cc:1905] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:24.149394 19641 ts_tablet_manager.cc:1905] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:24.150895 19640 ts_tablet_manager.cc:1918] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:24.151077 19640 log.cc:1196] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/045049f321614710b5e393322eaea808
I20260810 18:35:24.151639 19640 ts_tablet_manager.cc:1939] T 045049f321614710b5e393322eaea808 P c6534a7a8f6c47acb9f63ec3faef9ebf: Deleting consensus metadata
I20260810 18:35:24.153601 19084 catalog_manager.cc:4841] TS c6534a7a8f6c47acb9f63ec3faef9ebf (127.13.139.2:41209): tablet 045049f321614710b5e393322eaea808 (table test-table [id=a25d9181d3854eedb44a0c44748204c5]) successfully deleted
I20260810 18:35:24.155823 19641 ts_tablet_manager.cc:1918] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:24.155992 19641 log.cc:1196] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/045049f321614710b5e393322eaea808
I20260810 18:35:24.156461 19641 ts_tablet_manager.cc:1939] T 045049f321614710b5e393322eaea808 P ef0c7db1da47449c981bb5690b9ba98b: Deleting consensus metadata
I20260810 18:35:24.157979 19087 catalog_manager.cc:4841] TS ef0c7db1da47449c981bb5690b9ba98b (127.13.139.3:36831): tablet 045049f321614710b5e393322eaea808 (table test-table [id=a25d9181d3854eedb44a0c44748204c5]) successfully deleted
I20260810 18:35:24.143504 19642 ts_tablet_manager.cc:1905] T 045049f321614710b5e393322eaea808 P 10dd6f73b9c14f1b99f84a113b2e365d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:24.248764 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19164
W20260810 18:35:24.268754 19084 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:38327 (error 108)
I20260810 18:35:24.268997 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19308
I20260810 18:35:24.270962 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.270350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:60198)
0810 18:35:24.270540 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.270762 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260810 18:35:24.271239 19084 catalog_manager.cc:4584] TS 10dd6f73b9c14f1b99f84a113b2e365d (127.13.139.1:38327): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 045049f321614710b5e393322eaea808: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
I20260810 18:35:24.272485 19611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.269824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43888 (local address 127.13.139.2:41209)
0810 18:35:24.270024 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:24.270031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:24.270136 (+ 105us) server_negotiation.cc:407] Connection header received
0810 18:35:24.270354 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:24.270364 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:24.270501 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:24.270632 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:24.271824 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:24.271834 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:24.271837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:24.271854 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:24.271885 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:24.271896 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:24.272030 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:24.272152 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 18:35:24.272214 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:35:24.273157 19443 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:24.324782 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.324314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:56736)
0810 18:35:24.324534 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.324615 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 18:35:24.325804 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.325430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:56746)
0810 18:35:24.325613 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.325693 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 18:35:24.361433 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19308
I20260810 18:35:24.385073 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19452
I20260810 18:35:24.386842 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.386315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:56758)
0810 18:35:24.386538 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.386662 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260810 18:35:24.387923 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.387569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:56764)
0810 18:35:24.387721 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.387802 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 18:35:24.388540 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.385845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51290 (local address 127.13.139.3:36831)
0810 18:35:24.386043 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:24.386048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:24.386157 (+ 109us) server_negotiation.cc:407] Connection header received
0810 18:35:24.386424 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:24.386437 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:24.386564 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:24.386679 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:24.387755 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:24.387759 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:24.387763 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:24.387778 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:24.387808 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:24.387820 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:24.387988 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:24.388277 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 18:35:24.388326 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260810 18:35:24.389174 19588 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:24.468750 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.468232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:56774)
0810 18:35:24.468489 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.468586 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260810 18:35:24.469879 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:24.469482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:38327 (local address 127.0.0.1:56784)
0810 18:35:24.469681 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:24.469751 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:38327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260810 18:35:24.480043 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19452
I20260810 18:35:24.500900 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19068
I20260810 18:35:24.502319 19133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:24.609120 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19068
2026-08-10T18:35:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2726 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 18:35:24.654667 13868 mini_oidc.cc:152] Starting JWKS server
I20260810 18:35:24.657637 13868 webserver.cc:460] Webserver started at https://127.0.0.1:44913/ using document root <none> and password file <none>
I20260810 18:35:24.658005 13868 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 18:35:24.658763 13868 webserver.cc:460] Webserver started at http://127.0.0.1:41219/ using document root <none> and password file <none>
2026-08-10T18:35:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:24Z Disabled control of system clock
I20260810 18:35:24.691156 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:34163
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:42217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:34163
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44913/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/testchainca.cert with env {}
W20260810 18:35:25.023126 19655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:25.023547 19655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:25.023715 19655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:25.031076 19655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:25.031224 19655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:25.031319 19655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:25.031484 19655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:25.031579 19655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 18:35:25.031670 19655 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 18:35:25.031749 19655 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44913/jwks.json
I20260810 18:35:25.041889 19655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:34163
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:34163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44913/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:25.043253 19655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:25.044652 19655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:25.056546 19661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:25.056552 19662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:25.056861 19664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:25.057536 19655 server_base.cc:1034] running on GCE node
I20260810 18:35:25.058379 19655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:25.059952 19655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:25.061185 19655 hybrid_clock.cc:648] HybridClock initialized: now 1786386925061138 us; error 58 us; skew 500 ppm
I20260810 18:35:25.061542 19655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:25.063876 19655 webserver.cc:460] Webserver started at http://127.13.139.62:36853/ using document root <none> and password file <none>
I20260810 18:35:25.064634 19655 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:25.064785 19655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:25.065107 19655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:25.068128 19655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "2c5b6a88ab53486c80f054197e46eabd"
format_stamp: "Formatted at 2026-08-10 18:35:25 on dist-test-slave-5k54"
server_key: "75cf1b0154b0078c8a333e131c77fffb"
server_key_iv: "3feb0cc2c6d27e23d82e06c855789471"
server_key_version: "encryptionkey@0"
I20260810 18:35:25.068944 19655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "2c5b6a88ab53486c80f054197e46eabd"
format_stamp: "Formatted at 2026-08-10 18:35:25 on dist-test-slave-5k54"
server_key: "75cf1b0154b0078c8a333e131c77fffb"
server_key_iv: "3feb0cc2c6d27e23d82e06c855789471"
server_key_version: "encryptionkey@0"
I20260810 18:35:25.074219 19655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:35:25.077668 19670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:25.078949 19655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:35:25.079145 19655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "2c5b6a88ab53486c80f054197e46eabd"
format_stamp: "Formatted at 2026-08-10 18:35:25 on dist-test-slave-5k54"
server_key: "75cf1b0154b0078c8a333e131c77fffb"
server_key_iv: "3feb0cc2c6d27e23d82e06c855789471"
server_key_version: "encryptionkey@0"
I20260810 18:35:25.079365 19655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:25.100308 19655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:25.101207 19655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:25.101544 19655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:25.120421 19655 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:34163
I20260810 18:35:25.120453 19723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:34163 every 8 connection(s)
I20260810 18:35:25.121829 19655 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:25.125869 19724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:25.131196 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19655
I20260810 18:35:25.131451 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:25.132110 13868 external_mini_cluster.cc:1428] Setting key 5fe5312b7e9a2da6a0191439365dd5d1
I20260810 18:35:25.136925 19724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd: Bootstrap starting.
I20260810 18:35:25.140646 19724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:25.141934 19724 log.cc:824] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:25.145388 19724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd: No bootstrap required, opened a new log
I20260810 18:35:25.147135 19728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:25.134025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42890 (local address 127.13.139.62:34163)
0810 18:35:25.135114 (+ 1089us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:25.135125 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:25.135166 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:35:25.137244 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:25.137268 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:25.137740 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:25.138086 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:25.138886 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.140248 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.142225 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.143274 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.143505 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:25.144813 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:25.144821 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:25.144835 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:25.145354 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:25.145467 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:25.145511 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:25.145633 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:25.145859 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 18:35:25.146203 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":412,"threads_started":1}
I20260810 18:35:25.150938 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:35:25.154434 19724 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5b6a88ab53486c80f054197e46eabd" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 34163 } }
I20260810 18:35:25.154789 19724 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:25.154929 19724 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5b6a88ab53486c80f054197e46eabd, State: Initialized, Role: FOLLOWER
I20260810 18:35:25.155580 19724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5b6a88ab53486c80f054197e46eabd" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 34163 } }
I20260810 18:35:25.155817 19724 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:25.155956 19724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:25.156131 19724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:25.158267 19724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5b6a88ab53486c80f054197e46eabd" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 34163 } }
I20260810 18:35:25.158764 19724 leader_election.cc:302] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c5b6a88ab53486c80f054197e46eabd; no voters:
I20260810 18:35:25.159341 19724 leader_election.cc:288] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:25.159602 19730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:25.160900 19730 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [term 1 LEADER]: Becoming Leader. State: Replica: 2c5b6a88ab53486c80f054197e46eabd, State: Running, Role: LEADER
I20260810 18:35:25.161438 19730 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5b6a88ab53486c80f054197e46eabd" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 34163 } }
I20260810 18:35:25.162029 19724 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:25.164232 19731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c5b6a88ab53486c80f054197e46eabd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5b6a88ab53486c80f054197e46eabd" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 34163 } } }
I20260810 18:35:25.165058 19731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:25.165709 19733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c5b6a88ab53486c80f054197e46eabd. Latest consensus state: current_term: 1 leader_uuid: "2c5b6a88ab53486c80f054197e46eabd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c5b6a88ab53486c80f054197e46eabd" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 34163 } } }
I20260810 18:35:25.166023 19733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:25.166733 19740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:25.172132 19740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:25.180950 19740 catalog_manager.cc:1347] Generated new cluster ID: 725a552cdf624cc1b7198953e5105824
I20260810 18:35:25.181062 19740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:25.195118 19740 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:25.196897 19740 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:25.208541 19740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c5b6a88ab53486c80f054197e46eabd: Generated new TSK 0
I20260810 18:35:25.209551 19740 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 18:35:25.251694 19759 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 18:35:25.252077 19759 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 18:35:25.253044 19728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:25.231052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42898 (local address 127.13.139.62:34163)
0810 18:35:25.231269 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:25.231281 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:25.231782 (+ 501us) server_negotiation.cc:407] Connection header received
0810 18:35:25.232146 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:25.232153 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:25.232266 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:25.232417 (+ 151us) server_negotiation.cc:226] Negotiated authn=JWT
0810 18:35:25.232932 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.234076 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.235464 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.236119 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.236258 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:25.236758 (+ 500us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 18:35:25.252346 (+ 15588us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44913/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 18:35:25.252736 (+ 390us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44913/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 18:35:25.253183 19728 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44913/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 18:35:25.254794 19758 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:25.230960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:34163 (local address 127.0.0.1:42898)
0810 18:35:25.231678 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:25.231694 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:25.231860 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:25.232460 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:25.232464 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:25.232474 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0810 18:35:25.232792 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:25.232799 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.234203 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.234206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:25.235307 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:25.235317 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.236289 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.236294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:25.236428 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:25.236486 (+ 58us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 18:35:25.252612 (+ 16126us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44913/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 18:35:25.252896 (+ 284us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.139.62:34163: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44913/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":377,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.13.139.62:34163: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44913/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 18:35:25.256944 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19655
I20260810 18:35:25.258013 19718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:25.350260 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19655
2026-08-10T18:35:25Z chronyd exiting
I20260810 18:35:25.403514 13868 test_util.cc:175] -----------------------------------------------
I20260810 18:35:25.403661 13868 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786386879896169-13868-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (753 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 18:35:25.407471 13868 mini_oidc.cc:152] Starting JWKS server
I20260810 18:35:25.409341 13868 webserver.cc:460] Webserver started at https://127.0.0.1:39901/ using document root <none> and password file <none>
I20260810 18:35:25.409578 13868 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 18:35:25.410235 13868 webserver.cc:460] Webserver started at http://127.0.0.1:38285/ using document root <none> and password file <none>
2026-08-10T18:35:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:25Z Disabled control of system clock
I20260810 18:35:25.443367 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36457
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:35671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:36457
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39901/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/testchainca.cert with env {}
W20260810 18:35:25.765818 19766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:25.766166 19766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:25.766340 19766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:25.773504 19766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:25.773650 19766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:25.773742 19766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:25.773851 19766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:25.773945 19766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 18:35:25.774036 19766 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 18:35:25.774117 19766 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39901/jwks.json
I20260810 18:35:25.784643 19766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:35671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:36457
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39901/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:25.786008 19766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:25.787362 19766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:25.799453 19776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:25.799409 19774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:25.799520 19772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:25.800101 19766 server_base.cc:1034] running on GCE node
I20260810 18:35:25.800845 19766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:25.802184 19766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:25.803412 19766 hybrid_clock.cc:648] HybridClock initialized: now 1786386925803378 us; error 50 us; skew 500 ppm
I20260810 18:35:25.803835 19766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:25.810864 19766 webserver.cc:460] Webserver started at http://127.13.139.62:42893/ using document root <none> and password file <none>
I20260810 18:35:25.811717 19766 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:25.811856 19766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:25.812216 19766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:25.815164 19766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "7c51bf0edfff4fa084ad83903e226355"
format_stamp: "Formatted at 2026-08-10 18:35:25 on dist-test-slave-5k54"
server_key: "340216cc228136eb356e96f6cf640de1"
server_key_iv: "7ffd68fd545dd839d8bdadd3bb191d7c"
server_key_version: "encryptionkey@0"
I20260810 18:35:25.816075 19766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "7c51bf0edfff4fa084ad83903e226355"
format_stamp: "Formatted at 2026-08-10 18:35:25 on dist-test-slave-5k54"
server_key: "340216cc228136eb356e96f6cf640de1"
server_key_iv: "7ffd68fd545dd839d8bdadd3bb191d7c"
server_key_version: "encryptionkey@0"
I20260810 18:35:25.821465 19766 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260810 18:35:25.825246 19783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:25.826682 19766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:35:25.826901 19766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "7c51bf0edfff4fa084ad83903e226355"
format_stamp: "Formatted at 2026-08-10 18:35:25 on dist-test-slave-5k54"
server_key: "340216cc228136eb356e96f6cf640de1"
server_key_iv: "7ffd68fd545dd839d8bdadd3bb191d7c"
server_key_version: "encryptionkey@0"
I20260810 18:35:25.827147 19766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:25.839152 19766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:25.840072 19766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:25.840389 19766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:25.859179 19766 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:36457
I20260810 18:35:25.859185 19841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:36457 every 8 connection(s)
I20260810 18:35:25.860610 19766 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:25.862370 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19766
I20260810 18:35:25.862600 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:25.863252 13868 external_mini_cluster.cc:1428] Setting key 1e283ce608ab1cc11f44bcdce54e27cb
I20260810 18:35:25.865139 19842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:25.877535 19846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:25.865303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50364 (local address 127.13.139.62:36457)
0810 18:35:25.866322 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:25.866333 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:25.866374 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:35:25.868040 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:25.868065 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:25.868544 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:25.868898 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:25.869516 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.870851 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.872849 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.873555 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.873695 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:25.874995 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:25.875005 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:25.875018 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:25.875681 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:25.875759 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:25.875780 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:25.875902 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:25.876183 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 18:35:25.876574 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":392,"threads_started":1}
I20260810 18:35:25.878846 19842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355: Bootstrap starting.
I20260810 18:35:25.881561 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:35:25.882390 19842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:25.883396 19842 log.cc:824] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:25.886404 19842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355: No bootstrap required, opened a new log
I20260810 18:35:25.894227 19842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c51bf0edfff4fa084ad83903e226355" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36457 } }
I20260810 18:35:25.894589 19842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:25.894714 19842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c51bf0edfff4fa084ad83903e226355, State: Initialized, Role: FOLLOWER
I20260810 18:35:25.895289 19842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c51bf0edfff4fa084ad83903e226355" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36457 } }
I20260810 18:35:25.895624 19842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:25.895776 19842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:25.895962 19842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:25.898533 19842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c51bf0edfff4fa084ad83903e226355" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36457 } }
I20260810 18:35:25.899035 19842 leader_election.cc:302] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c51bf0edfff4fa084ad83903e226355; no voters:
I20260810 18:35:25.899688 19842 leader_election.cc:288] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:25.899816 19849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:25.900585 19849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [term 1 LEADER]: Becoming Leader. State: Replica: 7c51bf0edfff4fa084ad83903e226355, State: Running, Role: LEADER
I20260810 18:35:25.901091 19849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c51bf0edfff4fa084ad83903e226355" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36457 } }
I20260810 18:35:25.901717 19842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:25.904098 19851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c51bf0edfff4fa084ad83903e226355. Latest consensus state: current_term: 1 leader_uuid: "7c51bf0edfff4fa084ad83903e226355" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c51bf0edfff4fa084ad83903e226355" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36457 } } }
I20260810 18:35:25.904732 19851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:25.904243 19850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c51bf0edfff4fa084ad83903e226355" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c51bf0edfff4fa084ad83903e226355" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36457 } } }
I20260810 18:35:25.909479 19850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:25.911485 19859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:25.916572 19859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:25.925493 19859 catalog_manager.cc:1347] Generated new cluster ID: 36ee853c8288449abefa1febd3f306a1
I20260810 18:35:25.925606 19859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:25.946805 19859 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:25.948604 19859 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:25.961421 19859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c51bf0edfff4fa084ad83903e226355: Generated new TSK 0
I20260810 18:35:25.962252 19859 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 18:35:26.006268 19875 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 18:35:26.006413 19875 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 18:35:26.007759 19846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:25.986663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50370 (local address 127.13.139.62:36457)
0810 18:35:25.986850 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:25.986857 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:25.987266 (+ 409us) server_negotiation.cc:407] Connection header received
0810 18:35:25.987514 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:25.987520 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:25.987619 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:25.987787 (+ 168us) server_negotiation.cc:226] Negotiated authn=JWT
0810 18:35:25.988305 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.989437 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.990781 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.991542 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.991663 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:25.992155 (+ 492us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 18:35:26.007010 (+ 14855us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 18:35:26.007397 (+ 387us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50370: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":70}
W20260810 18:35:26.007887 19846 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50370: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 18:35:26.007933 19874 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:25.986540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36457 (local address 127.0.0.1:50370)
0810 18:35:25.987160 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:25.987179 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:25.987302 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:25.987849 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:25.987853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:25.987864 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0810 18:35:25.988135 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:25.988144 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.989591 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.989595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:25.990646 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:25.990656 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:25.991699 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:25.991704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:25.991843 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:25.991876 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 18:35:26.007277 (+ 15401us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 18:35:26.007594 (+ 317us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.139.62:36457: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39901/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":342,"threads_started":1}
I20260810 18:35:26.009392 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19766
I20260810 18:35:26.010756 19837 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:26.105053 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19766
2026-08-10T18:35:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (755 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 18:35:26.162834 13868 mini_oidc.cc:152] Starting JWKS server
I20260810 18:35:26.164822 13868 webserver.cc:460] Webserver started at https://127.0.0.1:43681/ using document root <none> and password file <none>
I20260810 18:35:26.165098 13868 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 18:35:26.165704 13868 webserver.cc:460] Webserver started at http://127.0.0.1:42017/ using document root <none> and password file <none>
2026-08-10T18:35:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:26Z Disabled control of system clock
I20260810 18:35:26.198177 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:40695
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:42873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:40695
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43681/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 18:35:26.521620 19884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:26.521981 19884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:26.522157 19884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:26.529371 19884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:26.529521 19884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:26.529594 19884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:26.529677 19884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:26.529764 19884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 18:35:26.529860 19884 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 18:35:26.529919 19884 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43681/jwks.json
I20260810 18:35:26.538865 19884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:40695
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:40695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43681/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:26.540207 19884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:26.542063 19884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:26.553647 19889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:26.553767 19890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:26.553767 19892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:26.554685 19884 server_base.cc:1034] running on GCE node
I20260810 18:35:26.555572 19884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:26.556856 19884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:26.558055 19884 hybrid_clock.cc:648] HybridClock initialized: now 1786386926558019 us; error 30 us; skew 500 ppm
I20260810 18:35:26.558353 19884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:26.560576 19884 webserver.cc:460] Webserver started at http://127.13.139.62:42509/ using document root <none> and password file <none>
I20260810 18:35:26.561200 19884 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:26.561307 19884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:26.561564 19884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:26.564410 19884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "b5691254e8a548f9a10a785251faaac6"
format_stamp: "Formatted at 2026-08-10 18:35:26 on dist-test-slave-5k54"
server_key: "48b756b60bef5073d86338ae5b35dfdf"
server_key_iv: "7d48d382939e147d224e3f866e8ab168"
server_key_version: "encryptionkey@0"
I20260810 18:35:26.565179 19884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "b5691254e8a548f9a10a785251faaac6"
format_stamp: "Formatted at 2026-08-10 18:35:26 on dist-test-slave-5k54"
server_key: "48b756b60bef5073d86338ae5b35dfdf"
server_key_iv: "7d48d382939e147d224e3f866e8ab168"
server_key_version: "encryptionkey@0"
I20260810 18:35:26.570431 19884 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:35:26.573947 19898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:26.575265 19884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:35:26.575510 19884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "b5691254e8a548f9a10a785251faaac6"
format_stamp: "Formatted at 2026-08-10 18:35:26 on dist-test-slave-5k54"
server_key: "48b756b60bef5073d86338ae5b35dfdf"
server_key_iv: "7d48d382939e147d224e3f866e8ab168"
server_key_version: "encryptionkey@0"
I20260810 18:35:26.575731 19884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:26.591812 19884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:26.592585 19884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:26.592883 19884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:26.611259 19884 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:40695
I20260810 18:35:26.611496 19957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:40695 every 8 connection(s)
I20260810 18:35:26.612644 19884 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:26.616289 19958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:26.617251 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19884
I20260810 18:35:26.617498 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:26.618346 13868 external_mini_cluster.cc:1428] Setting key 629d7c9c21c57a59f2491284711ff5f5
I20260810 18:35:26.631120 19958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6: Bootstrap starting.
I20260810 18:35:26.632247 19961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:26.620328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51066 (local address 127.13.139.62:40695)
0810 18:35:26.621388 (+ 1060us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:26.621399 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:26.621441 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:35:26.622986 (+ 1545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:26.623006 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:26.623512 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:26.623853 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:26.624448 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:26.625777 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:26.627759 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:26.628468 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:26.628605 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:26.629870 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:26.629878 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:26.629890 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:26.630404 (+ 514us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:26.630485 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:26.630505 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:26.630588 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:26.630892 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 18:35:26.631221 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":420,"threads_started":1}
I20260810 18:35:26.634945 19958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:26.636186 19958 log.cc:824] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:26.636240 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:35:26.639061 19958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6: No bootstrap required, opened a new log
I20260810 18:35:26.646898 19958 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5691254e8a548f9a10a785251faaac6" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40695 } }
I20260810 18:35:26.647269 19958 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:26.647382 19958 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5691254e8a548f9a10a785251faaac6, State: Initialized, Role: FOLLOWER
I20260810 18:35:26.647958 19958 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5691254e8a548f9a10a785251faaac6" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40695 } }
I20260810 18:35:26.648198 19958 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:26.648344 19958 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:26.648521 19958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:26.650655 19958 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5691254e8a548f9a10a785251faaac6" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40695 } }
I20260810 18:35:26.651162 19958 leader_election.cc:302] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5691254e8a548f9a10a785251faaac6; no voters:
I20260810 18:35:26.651808 19958 leader_election.cc:288] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:26.651969 19964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:26.653319 19964 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [term 1 LEADER]: Becoming Leader. State: Replica: b5691254e8a548f9a10a785251faaac6, State: Running, Role: LEADER
I20260810 18:35:26.653841 19964 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5691254e8a548f9a10a785251faaac6" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40695 } }
I20260810 18:35:26.654091 19958 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:26.656772 19965 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5691254e8a548f9a10a785251faaac6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5691254e8a548f9a10a785251faaac6" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40695 } } }
I20260810 18:35:26.656739 19966 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5691254e8a548f9a10a785251faaac6. Latest consensus state: current_term: 1 leader_uuid: "b5691254e8a548f9a10a785251faaac6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5691254e8a548f9a10a785251faaac6" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40695 } } }
I20260810 18:35:26.657138 19965 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:26.657203 19966 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:26.658645 19972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:26.664381 19972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:26.673614 19972 catalog_manager.cc:1347] Generated new cluster ID: 72e3c8eb4e87440d9d558da4db59980f
I20260810 18:35:26.673738 19972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:26.692648 19972 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:26.693917 19972 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:26.701337 19972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5691254e8a548f9a10a785251faaac6: Generated new TSK 0
I20260810 18:35:26.702162 19972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:35:26.732642 19961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:26.724224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51082 (local address 127.13.139.62:40695)
0810 18:35:26.724427 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:26.724434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:26.724814 (+ 380us) server_negotiation.cc:407] Connection header received
0810 18:35:26.725044 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:26.725050 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:26.725146 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:26.725317 (+ 171us) server_negotiation.cc:226] Negotiated authn=JWT
0810 18:35:26.725766 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:26.726939 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:26.728334 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:26.729013 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:26.729142 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:26.729606 (+ 464us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 18:35:26.732002 (+ 2396us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43681/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 18:35:26.732331 (+ 329us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51082: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43681/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":67}
W20260810 18:35:26.732776 19961 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51082: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43681/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 18:35:26.734375 19990 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:26.724079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:40695 (local address 127.0.0.1:51082)
0810 18:35:26.724695 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:26.724711 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:26.724845 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:26.725329 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:26.725332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:26.725341 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0810 18:35:26.725620 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:26.725628 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:26.727089 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:26.727092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:26.728192 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:26.728203 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:26.729184 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:26.729189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:26.729324 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:26.729355 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 18:35:26.732203 (+ 2848us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43681/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 18:35:26.733946 (+ 1743us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.139.62:40695: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43681/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":1421,"thread_start_us":329,"threads_started":1}
I20260810 18:35:26.735821 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19884
I20260810 18:35:26.737048 19953 generic_service.cc:196] Checking for leaks (request via RPC)
E20260810 18:35:26.744464 19991 webserver.cc:533] Webserver: sslize failed:
E20260810 18:35:26.744580 19991 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 18:35:26.828850 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19884
2026-08-10T18:35:26Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (723 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T18:35:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:26Z Disabled control of system clock
I20260810 18:35:26.918890 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43247
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:40337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:43247
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/testchainca.cert with env {}
W20260810 18:35:27.244190 19996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:27.244483 19996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:27.244575 19996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:27.251745 19996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:27.251842 19996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:27.251879 19996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:27.251935 19996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:27.251992 19996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 18:35:27.252053 19996 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 18:35:27.252092 19996 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 18:35:27.261909 19996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:43247
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:27.263134 19996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:27.264389 19996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:27.276577 20001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:27.276546 20004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:27.276635 20002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:27.277467 19996 server_base.cc:1034] running on GCE node
I20260810 18:35:27.278260 19996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:27.279654 19996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:27.280877 19996 hybrid_clock.cc:648] HybridClock initialized: now 1786386927280833 us; error 56 us; skew 500 ppm
I20260810 18:35:27.281229 19996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:35:27.283540 19996 webserver.cc:460] Webserver started at http://127.13.139.62:40303/ using document root <none> and password file <none>
I20260810 18:35:27.284236 19996 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:27.284365 19996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:27.284677 19996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:27.287556 19996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "ce704e437b40423fa122b0f7cdc07312"
format_stamp: "Formatted at 2026-08-10 18:35:27 on dist-test-slave-5k54"
server_key: "370b55bad14afd475a47a45ecc88d34d"
server_key_iv: "83a61d07de8aabcafeb6d6f6044a3b1f"
server_key_version: "encryptionkey@0"
I20260810 18:35:27.288444 19996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "ce704e437b40423fa122b0f7cdc07312"
format_stamp: "Formatted at 2026-08-10 18:35:27 on dist-test-slave-5k54"
server_key: "370b55bad14afd475a47a45ecc88d34d"
server_key_iv: "83a61d07de8aabcafeb6d6f6044a3b1f"
server_key_version: "encryptionkey@0"
I20260810 18:35:27.293395 19996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:35:27.296752 20010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:27.298153 19996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:35:27.298331 19996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "ce704e437b40423fa122b0f7cdc07312"
format_stamp: "Formatted at 2026-08-10 18:35:27 on dist-test-slave-5k54"
server_key: "370b55bad14afd475a47a45ecc88d34d"
server_key_iv: "83a61d07de8aabcafeb6d6f6044a3b1f"
server_key_version: "encryptionkey@0"
I20260810 18:35:27.298554 19996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:27.318805 19996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:27.319635 19996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:27.319921 19996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:27.338544 19996 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:43247
I20260810 18:35:27.338634 20064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:43247 every 8 connection(s)
I20260810 18:35:27.339884 19996 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:27.343544 20065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:27.349138 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 19996
I20260810 18:35:27.349349 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:27.350250 13868 external_mini_cluster.cc:1428] Setting key 1d217f90fb60d76d706d8e74e6a2f967
I20260810 18:35:27.354441 20065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312: Bootstrap starting.
I20260810 18:35:27.357908 20065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:27.359109 20065 log.cc:824] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:27.362391 20065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312: No bootstrap required, opened a new log
I20260810 18:35:27.364260 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:27.352197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39290 (local address 127.13.139.62:43247)
0810 18:35:27.353218 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:27.353228 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:27.353272 (+ 44us) server_negotiation.cc:407] Connection header received
0810 18:35:27.354947 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:27.354969 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:27.355381 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:27.355761 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:27.356367 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:27.357689 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:27.359516 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:27.360619 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:27.360744 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:27.361981 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:27.361988 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:27.362000 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:35:27.362551 (+ 551us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:27.362644 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:35:27.362664 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:27.362748 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:27.362994 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 18:35:27.363303 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":412,"threads_started":1}
I20260810 18:35:27.367898 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:35:27.371292 20065 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce704e437b40423fa122b0f7cdc07312" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43247 } }
I20260810 18:35:27.371697 20065 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:27.371807 20065 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce704e437b40423fa122b0f7cdc07312, State: Initialized, Role: FOLLOWER
I20260810 18:35:27.372332 20065 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce704e437b40423fa122b0f7cdc07312" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43247 } }
I20260810 18:35:27.372555 20065 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:27.372702 20065 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:27.372871 20065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:27.374919 20065 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce704e437b40423fa122b0f7cdc07312" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43247 } }
I20260810 18:35:27.375392 20065 leader_election.cc:302] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce704e437b40423fa122b0f7cdc07312; no voters:
I20260810 18:35:27.376186 20065 leader_election.cc:288] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:27.376346 20070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:27.377056 20070 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [term 1 LEADER]: Becoming Leader. State: Replica: ce704e437b40423fa122b0f7cdc07312, State: Running, Role: LEADER
I20260810 18:35:27.377604 20070 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce704e437b40423fa122b0f7cdc07312" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43247 } }
I20260810 18:35:27.378197 20065 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:27.380815 20072 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce704e437b40423fa122b0f7cdc07312. Latest consensus state: current_term: 1 leader_uuid: "ce704e437b40423fa122b0f7cdc07312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce704e437b40423fa122b0f7cdc07312" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43247 } } }
I20260810 18:35:27.381145 20072 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:27.381489 20071 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce704e437b40423fa122b0f7cdc07312" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce704e437b40423fa122b0f7cdc07312" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43247 } } }
I20260810 18:35:27.381942 20071 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:27.384346 20077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:27.389644 20077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:27.399055 20077 catalog_manager.cc:1347] Generated new cluster ID: 4d4819d24d9a4d59a8825a3c08355d83
I20260810 18:35:27.399178 20077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:27.414655 20077 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:27.416155 20077 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:27.424291 20077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce704e437b40423fa122b0f7cdc07312: Generated new TSK 0
I20260810 18:35:27.425207 20077 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:35:27.899360 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:27.449736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39306 (local address 127.13.139.62:43247)
0810 18:35:27.449935 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:27.449941 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:27.450548 (+ 607us) server_negotiation.cc:407] Connection header received
0810 18:35:27.450672 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:27.450677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:27.450759 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:27.450992 (+ 233us) server_negotiation.cc:226] Negotiated authn=JWT
0810 18:35:27.451391 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:27.452621 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:27.453951 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:27.454649 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:27.454784 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:27.455231 (+ 447us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 18:35:27.898576 (+443345us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 18:35:27.899019 (+ 443us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39306: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":63}
W20260810 18:35:27.899534 20068 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39306: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 18:35:27.899652 20096 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:27.449737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:43247 (local address 127.0.0.1:39306)
0810 18:35:27.450356 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:27.450372 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:27.450486 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:27.450996 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:27.450999 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:27.451007 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 18:35:27.451241 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:27.451248 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:27.452765 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:27.452768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:27.453799 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:27.453809 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:27.454814 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:27.454818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:27.454954 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:27.454985 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 18:35:27.898908 (+443923us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 18:35:27.899215 (+ 307us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.139.62:43247: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":344,"threads_started":1}
I20260810 18:35:27.900998 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 19996
I20260810 18:35:27.902340 20060 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:28.005563 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 19996
2026-08-10T18:35:28Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1160 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (415 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (414 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:28 dist-test-slave-5k54 krb5kdc[20112](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:28 dist-test-slave-5k54 krb5kdc[20112](info): set up 2 sockets
Aug 10 18:35:28 dist-test-slave-5k54 krb5kdc[20112](info): commencing operation
krb5kdc: starting...
W20260810 18:35:30.003175 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.004s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:30 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:30.237529 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:40791
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:40791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:30.563818 20125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:30.564204 20125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:30.564364 20125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:30.571691 20125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:30.571825 20125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:30.571931 20125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:30.572039 20125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:30.572126 20125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:30.581851 20125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:40791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:40791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:30.583151 20125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:30.584503 20125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:30.596283 20131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:30.596274 20132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:30.596319 20134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:30.596988 20125 server_base.cc:1034] running on GCE node
I20260810 18:35:30.597767 20125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:30.599143 20125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:30.600365 20125 hybrid_clock.cc:648] HybridClock initialized: now 1786386930600332 us; error 46 us; skew 500 ppm
I20260810 18:35:30.600714 20125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:30 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386930, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:30.603757 20125 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:30.605217 20125 webserver.cc:460] Webserver started at http://127.13.139.62:46499/ using document root <none> and password file <none>
I20260810 18:35:30.605875 20125 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:30.606019 20125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:30.606385 20125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:30.609357 20125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "a05f2059ad15486f80db795027a3593c"
format_stamp: "Formatted at 2026-08-10 18:35:30 on dist-test-slave-5k54"
server_key: "bd969432a6b081517a214f2ced457234"
server_key_iv: "a267b29ccaeb161bf6ba3a65a312b4fd"
server_key_version: "encryptionkey@0"
I20260810 18:35:30.610133 20125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "a05f2059ad15486f80db795027a3593c"
format_stamp: "Formatted at 2026-08-10 18:35:30 on dist-test-slave-5k54"
server_key: "bd969432a6b081517a214f2ced457234"
server_key_iv: "a267b29ccaeb161bf6ba3a65a312b4fd"
server_key_version: "encryptionkey@0"
I20260810 18:35:30.615072 20125 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 18:35:30.618480 20142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:30.619827 20125 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:30.620010 20125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "a05f2059ad15486f80db795027a3593c"
format_stamp: "Formatted at 2026-08-10 18:35:30 on dist-test-slave-5k54"
server_key: "bd969432a6b081517a214f2ced457234"
server_key_iv: "a267b29ccaeb161bf6ba3a65a312b4fd"
server_key_version: "encryptionkey@0"
I20260810 18:35:30.620204 20125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:30.638329 20125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:30.642539 20125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:30.642832 20125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:30.661487 20125 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:40791
I20260810 18:35:30.661525 20197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:40791 every 8 connection(s)
I20260810 18:35:30.662869 20125 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:30.666687 20198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:30.668531 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 20125
I20260810 18:35:30.668756 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:30.669410 13868 external_mini_cluster.cc:1428] Setting key 97bcbe188c9aab7b500b6506c76f581e
I20260810 18:35:30.678705 20198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c: Bootstrap starting.
I20260810 18:35:30.682482 20198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:30.683823 20198 log.cc:824] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c: Log is configured to *not* fsync() on all Append() calls
Aug 10 18:35:30 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:30.686527 20198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c: No bootstrap required, opened a new log
I20260810 18:35:30.692410 20202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:30.671547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46466 (local address 127.13.139.62:40791)
0810 18:35:30.672361 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:30.672372 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:30.672424 (+ 52us) server_negotiation.cc:407] Connection header received
0810 18:35:30.674035 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:30.674055 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:30.674422 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:30.674727 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:30.676558 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:30.677854 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:30.679626 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:30.680280 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:30.680403 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:30.685206 (+ 4803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:30.685214 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:30.685228 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:30.685261 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:30.688378 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:30.689067 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:30.689074 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:30.689079 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:30.689248 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:30.689673 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:30.689676 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:30.689678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:30.690177 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:30.690519 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:30.690949 (+ 430us) server_negotiation.cc:299] Negotiation successful
0810 18:35:30.691373 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":367,"threads_started":1}
I20260810 18:35:30.694334 20198 raft_consensus.cc:348] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05f2059ad15486f80db795027a3593c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40791 } }
I20260810 18:35:30.694690 20198 raft_consensus.cc:374] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:30.694793 20198 raft_consensus.cc:729] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a05f2059ad15486f80db795027a3593c, State: Initialized, Role: FOLLOWER
I20260810 18:35:30.695461 20198 consensus_queue.cc:260] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05f2059ad15486f80db795027a3593c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40791 } }
I20260810 18:35:30.695711 20198 raft_consensus.cc:388] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:30.695864 20198 raft_consensus.cc:482] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:30.696040 20198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:30.698127 20198 raft_consensus.cc:504] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05f2059ad15486f80db795027a3593c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40791 } }
I20260810 18:35:30.698601 20198 leader_election.cc:302] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a05f2059ad15486f80db795027a3593c; no voters:
I20260810 18:35:30.699216 20198 leader_election.cc:288] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:30.699357 20204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:30.700125 20204 raft_consensus.cc:686] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [term 1 LEADER]: Becoming Leader. State: Replica: a05f2059ad15486f80db795027a3593c, State: Running, Role: LEADER
I20260810 18:35:30.700768 20204 consensus_queue.cc:237] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05f2059ad15486f80db795027a3593c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40791 } }
I20260810 18:35:30.701356 20198 sys_catalog.cc:564] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:30.703872 20206 sys_catalog.cc:455] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a05f2059ad15486f80db795027a3593c. Latest consensus state: current_term: 1 leader_uuid: "a05f2059ad15486f80db795027a3593c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05f2059ad15486f80db795027a3593c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40791 } } }
I20260810 18:35:30.704228 20206 sys_catalog.cc:458] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:30.705288 20205 sys_catalog.cc:455] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a05f2059ad15486f80db795027a3593c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05f2059ad15486f80db795027a3593c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40791 } } }
I20260810 18:35:30.705673 20205 sys_catalog.cc:458] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:30.709146 20209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:30.715646 20209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:30.724624 20209 catalog_manager.cc:1347] Generated new cluster ID: 1b69a9d6955e4794801a373fd0c67c88
I20260810 18:35:30.724740 20209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:30.740890 20209 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:30.742764 20209 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:30.759053 20209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a05f2059ad15486f80db795027a3593c: Generated new TSK 0
I20260810 18:35:30.760139 20209 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:35:30.826884 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40791
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:31.172176 20226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:31.172464 20226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:31.172662 20226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:31.179814 20226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:31.179913 20226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:31.180125 20226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:31.189700 20226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:31.190973 20226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:31.192435 20226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:31.206092 20233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:31.206259 20232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:31.206432 20235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:31.207322 20226 server_base.cc:1034] running on GCE node
I20260810 18:35:31.208042 20226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:31.209007 20226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:31.210253 20226 hybrid_clock.cc:648] HybridClock initialized: now 1786386931210205 us; error 42 us; skew 500 ppm
I20260810 18:35:31.210608 20226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:31 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386931, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:31.214212 20226 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:35:31.215654 20226 webserver.cc:460] Webserver started at http://127.13.139.1:33263/ using document root <none> and password file <none>
I20260810 18:35:31.216326 20226 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:31.216475 20226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:31.216774 20226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:31.219658 20226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "d1c6ae685270473bbe6a3a40be1a1630"
format_stamp: "Formatted at 2026-08-10 18:35:31 on dist-test-slave-5k54"
server_key: "bff49d167ac3dc69df33c21249af33df"
server_key_iv: "028a47e7581dfe18613bd20ec7eec24c"
server_key_version: "encryptionkey@0"
I20260810 18:35:31.220427 20226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "d1c6ae685270473bbe6a3a40be1a1630"
format_stamp: "Formatted at 2026-08-10 18:35:31 on dist-test-slave-5k54"
server_key: "bff49d167ac3dc69df33c21249af33df"
server_key_iv: "028a47e7581dfe18613bd20ec7eec24c"
server_key_version: "encryptionkey@0"
I20260810 18:35:31.225669 20226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260810 18:35:31.229076 20242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:31.230340 20226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:35:31.230530 20226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "d1c6ae685270473bbe6a3a40be1a1630"
format_stamp: "Formatted at 2026-08-10 18:35:31 on dist-test-slave-5k54"
server_key: "bff49d167ac3dc69df33c21249af33df"
server_key_iv: "028a47e7581dfe18613bd20ec7eec24c"
server_key_version: "encryptionkey@0"
I20260810 18:35:31.230739 20226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:31.250846 20226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:31.255215 20226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:31.255577 20226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:31.256534 20226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:31.257814 20226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:31.257920 20226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:31.258071 20226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:31.258142 20226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:31.291105 20226 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:46409
I20260810 18:35:31.291195 20364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:46409 every 8 connection(s)
I20260810 18:35:31.292459 20226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:31.297257 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 20226
I20260810 18:35:31.297469 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:31.298132 13868 external_mini_cluster.cc:1428] Setting key 95deb73c50e9f643f519e838638519f5
Aug 10 18:35:31 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386931, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:31.312724 20367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:31.295017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:47229 (local address 127.13.139.62:40791)
0810 18:35:31.295523 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:31.295531 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:31.296507 (+ 976us) server_negotiation.cc:407] Connection header received
0810 18:35:31.298505 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:31.298511 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:31.298603 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:31.298733 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:31.300280 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.301066 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.302627 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.303093 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.303229 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:31.306895 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:31.306900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:31.306903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:31.306937 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:31.309665 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:31.310463 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:31.310468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:31.310470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:31.310585 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:31.311013 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:31.311018 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:31.311023 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:31.311277 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:31.311463 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:31.312131 (+ 668us) server_negotiation.cc:299] Negotiation successful
0810 18:35:31.312358 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":216,"threads_started":1}
I20260810 18:35:31.313647 20368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:31.295636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:40791 (local address 127.13.139.1:47229)
0810 18:35:31.296345 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:31.296382 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:31.298197 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:31.298985 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:31.298993 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:31.299565 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:31.300113 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:31.300130 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.301218 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.301228 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:31.302482 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:31.302494 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.303332 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.303341 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:31.303620 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:31.304299 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:31.304326 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:31.306673 (+ 2347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:31.309799 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:31.309808 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:31.309823 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:31.310324 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:31.310695 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:31.310699 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:31.310703 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:31.310886 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:31.311404 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:31.311412 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:31.311749 (+ 337us) client_negotiation.cc:769] Sending connection context
0810 18:35:31.312010 (+ 261us) client_negotiation.cc:240] Negotiation successful
0810 18:35:31.312517 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":283,"threads_started":1}
I20260810 18:35:31.315264 20365 heartbeater.cc:347] Connected to a master server at 127.13.139.62:40791
I20260810 18:35:31.315639 20365 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:31.316529 20365 heartbeater.cc:511] Master 127.13.139.62:40791 requested a full tablet report, sending...
I20260810 18:35:31.319015 20161 ts_manager.cc:194] Registered new tserver with Master: d1c6ae685270473bbe6a3a40be1a1630 (127.13.139.1:46409)
I20260810 18:35:31.321244 20161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:47229
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:35:31.352638 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40791
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:31.679843 20371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:31.680333 20371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:31.680446 20371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:31.687707 20371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:31.687806 20371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:31.687925 20371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:31.697492 20371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:31.698679 20371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:31.699967 20371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:31.713042 20377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:31.713091 20380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:31.713130 20382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:31.713989 20371 server_base.cc:1034] running on GCE node
I20260810 18:35:31.714506 20371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:31.715332 20371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:31.716521 20371 hybrid_clock.cc:648] HybridClock initialized: now 1786386931716461 us; error 59 us; skew 500 ppm
I20260810 18:35:31.716820 20371 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:31 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386931, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:31.719875 20371 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:35:31.721333 20371 webserver.cc:460] Webserver started at http://127.13.139.2:33501/ using document root <none> and password file <none>
I20260810 18:35:31.721990 20371 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:31.722136 20371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:31.722441 20371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:31.725525 20371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "c84620c5356b4e4ca41ab8b779dde4b2"
format_stamp: "Formatted at 2026-08-10 18:35:31 on dist-test-slave-5k54"
server_key: "ba83b056d9fd6f319038a617f763792e"
server_key_iv: "1dc8df860248b812999eedb17a76824a"
server_key_version: "encryptionkey@0"
I20260810 18:35:31.726293 20371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "c84620c5356b4e4ca41ab8b779dde4b2"
format_stamp: "Formatted at 2026-08-10 18:35:31 on dist-test-slave-5k54"
server_key: "ba83b056d9fd6f319038a617f763792e"
server_key_iv: "1dc8df860248b812999eedb17a76824a"
server_key_version: "encryptionkey@0"
I20260810 18:35:31.731328 20371 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260810 18:35:31.734812 20391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:31.736234 20371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 18:35:31.736418 20371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "c84620c5356b4e4ca41ab8b779dde4b2"
format_stamp: "Formatted at 2026-08-10 18:35:31 on dist-test-slave-5k54"
server_key: "ba83b056d9fd6f319038a617f763792e"
server_key_iv: "1dc8df860248b812999eedb17a76824a"
server_key_version: "encryptionkey@0"
I20260810 18:35:31.736630 20371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:31.756984 20371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:31.761454 20371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:31.761765 20371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:31.762727 20371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:31.764099 20371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:31.764173 20371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:31.764354 20371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:31.764406 20371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:31.797138 20371 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:36589
I20260810 18:35:31.797183 20513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:36589 every 8 connection(s)
I20260810 18:35:31.798461 20371 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:31.805523 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 20371
I20260810 18:35:31.805723 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:31.806303 13868 external_mini_cluster.cc:1428] Setting key 90a99a7cf3d7451bba128c3ddd495304
Aug 10 18:35:31 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386931, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:31.819128 20367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:31.801070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:58817 (local address 127.13.139.62:40791)
0810 18:35:31.801341 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:31.801347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:31.802630 (+ 1283us) server_negotiation.cc:407] Connection header received
0810 18:35:31.804532 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:31.804536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:31.804610 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:31.804706 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:31.806691 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.807603 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.809130 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.809633 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.809763 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:31.813299 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:31.813304 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:31.813308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:31.813339 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:31.816137 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:31.816864 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:31.816872 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:31.816877 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:31.817011 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:31.817442 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:31.817449 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:31.817452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:31.817719 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:31.817883 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:31.818550 (+ 667us) server_negotiation.cc:299] Negotiation successful
0810 18:35:31.818773 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260810 18:35:31.820200 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:31.801669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:40791 (local address 127.13.139.2:58817)
0810 18:35:31.802478 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:31.802516 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:31.804197 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:31.804921 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:31.804929 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:31.805717 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:31.806515 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:31.806541 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.807755 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.807760 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:31.808982 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:31.808994 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:31.809860 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:31.809867 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:31.810101 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:31.810849 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:31.810875 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:31.813073 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:31.816280 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:31.816290 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:31.816309 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:31.816738 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:31.817123 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:31.817128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:31.817132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:31.817325 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:31.817848 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:31.817857 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:31.818193 (+ 336us) client_negotiation.cc:769] Sending connection context
0810 18:35:31.818477 (+ 284us) client_negotiation.cc:240] Negotiation successful
0810 18:35:31.819002 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":305,"threads_started":1}
I20260810 18:35:31.821712 20514 heartbeater.cc:347] Connected to a master server at 127.13.139.62:40791
I20260810 18:35:31.822050 20514 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:31.822988 20514 heartbeater.cc:511] Master 127.13.139.62:40791 requested a full tablet report, sending...
I20260810 18:35:31.824646 20161 ts_manager.cc:194] Registered new tserver with Master: c84620c5356b4e4ca41ab8b779dde4b2 (127.13.139.2:36589)
I20260810 18:35:31.825471 20161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:58817
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:35:31.860728 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40791
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:32.185899 20519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:32.186182 20519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:32.186280 20519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:32.193300 20519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:32.193400 20519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:32.193512 20519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:32.203388 20519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:32.204720 20519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:32.206038 20519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:32.219360 20524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:32.219463 20525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:32.219645 20527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:32.220381 20519 server_base.cc:1034] running on GCE node
I20260810 18:35:32.221011 20519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:32.221974 20519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:32.223202 20519 hybrid_clock.cc:648] HybridClock initialized: now 1786386932223146 us; error 46 us; skew 500 ppm
I20260810 18:35:32.223601 20519 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.226691 20519 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:35:32.228232 20519 webserver.cc:460] Webserver started at http://127.13.139.3:35657/ using document root <none> and password file <none>
I20260810 18:35:32.228914 20519 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:32.229074 20519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:32.229398 20519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:32.232399 20519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "38e5d2356904493a8fd0ee9845b9cb88"
format_stamp: "Formatted at 2026-08-10 18:35:32 on dist-test-slave-5k54"
server_key: "481290067725baae09fadc048b55258a"
server_key_iv: "de1d746d53f164f083aabcb1fce10d25"
server_key_version: "encryptionkey@0"
I20260810 18:35:32.233188 20519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "38e5d2356904493a8fd0ee9845b9cb88"
format_stamp: "Formatted at 2026-08-10 18:35:32 on dist-test-slave-5k54"
server_key: "481290067725baae09fadc048b55258a"
server_key_iv: "de1d746d53f164f083aabcb1fce10d25"
server_key_version: "encryptionkey@0"
I20260810 18:35:32.238518 20519 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:35:32.242215 20534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:32.243584 20519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:32.243774 20519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "38e5d2356904493a8fd0ee9845b9cb88"
format_stamp: "Formatted at 2026-08-10 18:35:32 on dist-test-slave-5k54"
server_key: "481290067725baae09fadc048b55258a"
server_key_iv: "de1d746d53f164f083aabcb1fce10d25"
server_key_version: "encryptionkey@0"
I20260810 18:35:32.244019 20519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:32.260615 20519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:32.264482 20519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:32.264724 20519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:32.265623 20519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:32.266880 20519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:32.266965 20519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:32.267066 20519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:32.267112 20519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:32.301314 20519 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:43881
I20260810 18:35:32.301403 20663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:43881 every 8 connection(s)
I20260810 18:35:32.302697 20519 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:32.312740 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 20519
I20260810 18:35:32.312983 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:32.313529 13868 external_mini_cluster.cc:1428] Setting key 6238ba2c5d0f908423d0f62ea17f0fa0
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:32.323037 20367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.305277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:58449 (local address 127.13.139.62:40791)
0810 18:35:32.305469 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.305473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.306497 (+ 1024us) server_negotiation.cc:407] Connection header received
0810 18:35:32.308468 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.308473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.308552 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.308656 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.310214 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.311064 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.312765 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.313247 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.313342 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.317361 (+ 4019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:32.317366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:32.317369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:32.317401 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:32.320196 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.320900 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.320904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.320922 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.321075 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.321539 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.321550 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.321552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.321809 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:32.321937 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:32.322611 (+ 674us) server_negotiation.cc:299] Negotiation successful
0810 18:35:32.322781 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:35:32.324169 20666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.305603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:40791 (local address 127.13.139.3:58449)
0810 18:35:32.306311 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:32.306347 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:32.308213 (+ 1866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:32.308860 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:32.308867 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:32.309447 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:32.310069 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:32.310086 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.311201 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.311205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:32.312626 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:32.312642 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.313480 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.313488 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:32.313800 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.314564 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:32.314592 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:32.317178 (+ 2586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:32.320330 (+ 3152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:32.320338 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:32.320351 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:32.320780 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:32.321188 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:32.321196 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:32.321202 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:32.321429 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:32.321924 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:32.321931 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:32.322257 (+ 326us) client_negotiation.cc:769] Sending connection context
0810 18:35:32.322495 (+ 238us) client_negotiation.cc:240] Negotiation successful
0810 18:35:32.322951 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":290,"threads_started":1}
I20260810 18:35:32.324445 20365 heartbeater.cc:503] Master 127.13.139.62:40791 was elected leader, sending a full tablet report...
I20260810 18:35:32.325913 20664 heartbeater.cc:347] Connected to a master server at 127.13.139.62:40791
I20260810 18:35:32.326282 20664 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:32.327028 20664 heartbeater.cc:511] Master 127.13.139.62:40791 requested a full tablet report, sending...
I20260810 18:35:32.328644 20160 ts_manager.cc:194] Registered new tserver with Master: 38e5d2356904493a8fd0ee9845b9cb88 (127.13.139.3:43881)
I20260810 18:35:32.329234 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:35:32.329762 20160 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:58449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/test-admin.keytab.
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.360721 13868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 18:35:32.366704 20672 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:32.363476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.13.139.1:46409)
0810 18:35:32.364710 (+ 1234us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.364717 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.364744 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:35:32.364818 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.364824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.365057 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.365203 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.366194 (+ 991us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53704: BlockingRecv error: recv got EOF from 127.0.0.1:53704 (error 108)
Metrics: {"server-negotiator.queue_time_us":1064,"thread_start_us":912,"threads_started":1}
W20260810 18:35:32.366734 13868 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5cc' of type FILE
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.368396 13868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.369843 13868 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:32.384999 20672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.371625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53720 (local address 127.13.139.1:46409)
0810 18:35:32.371895 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.371903 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.372045 (+ 142us) server_negotiation.cc:407] Connection header received
0810 18:35:32.372185 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.372189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.372250 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.372344 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.373300 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.374423 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.375639 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.376211 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.376315 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.379654 (+ 3339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:32.379664 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:32.379678 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:32.379708 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:32.382526 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.383124 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.383130 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.383132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.383249 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.383650 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.383653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.383655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.383978 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:32.384196 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:32.384419 (+ 223us) server_negotiation.cc:299] Negotiation successful
0810 18:35:32.384691 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 18:35:32.390427 20672 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:32.388849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53734 (local address 127.13.139.1:46409)
0810 18:35:32.389076 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.389082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.389249 (+ 167us) server_negotiation.cc:407] Connection header received
0810 18:35:32.389362 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.389366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.389430 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.389506 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.390171 (+ 665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53734: BlockingRecv error: recv got EOF from 127.0.0.1:53734 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260810 18:35:32.390542 13868 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5cc' of type FILE
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.392025 13868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.393294 13868 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:32.407796 20672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.394581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53746 (local address 127.13.139.1:46409)
0810 18:35:32.394758 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.394763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.395098 (+ 335us) server_negotiation.cc:407] Connection header received
0810 18:35:32.395217 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.395220 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.395275 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.395354 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.396328 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.397027 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.398301 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.398728 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.398819 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.402609 (+ 3790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:32.402614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:32.402617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:32.402661 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:32.405292 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.405928 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.405936 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.405941 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.406070 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.406456 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.406461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.406464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.406725 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:32.407002 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:32.407282 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 18:35:32.407533 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 18:35:32.412029 20672 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:32.410245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53754 (local address 127.13.139.1:46409)
0810 18:35:32.410395 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.410398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.410759 (+ 361us) server_negotiation.cc:407] Connection header received
0810 18:35:32.410886 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.410889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.410969 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.411046 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.411751 (+ 705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53754: BlockingRecv error: recv got EOF from 127.0.0.1:53754 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 18:35:32.412237 13868 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786386879896169-13868-0/krb5kdc/krb5cc' of type FILE
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.413717 13868 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:32.414978 13868 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:32.428347 20672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.416168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.13.139.1:46409)
0810 18:35:32.416383 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.416388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.416625 (+ 237us) server_negotiation.cc:407] Connection header received
0810 18:35:32.416729 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.416732 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.416783 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.416851 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.417645 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.418339 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.419516 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.419922 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.420011 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.423239 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:32.423243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:32.423246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:32.423276 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:32.425795 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.426419 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.426425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.426429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.426590 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.426946 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.426953 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.426957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.427233 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:32.427580 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:32.427835 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 18:35:32.428039 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:35:32.429847 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 20226
I20260810 18:35:32.442615 20672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.430622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53774 (local address 127.13.139.1:46409)
0810 18:35:32.430769 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.430773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.431084 (+ 311us) server_negotiation.cc:407] Connection header received
0810 18:35:32.431197 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.431200 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.431250 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.431325 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.432284 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.432929 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.434193 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.434757 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.434898 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.436913 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:32.436919 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:32.436924 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:32.436963 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:32.440232 (+ 3269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.441072 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.441076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.441078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.441204 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.441541 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.441544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.441546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.441781 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:32.441978 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:32.442199 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 18:35:32.442348 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 18:35:32.443251 20359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:32.532018 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 20226
I20260810 18:35:32.552670 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 20371
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:35:32.567734 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.553557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48528 (local address 127.13.139.2:36589)
0810 18:35:32.554167 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.554174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.554200 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:35:32.554261 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.554268 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.554472 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.554603 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.555572 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.556607 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.557758 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.558326 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.558419 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.562179 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:32.562188 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:32.562201 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:32.562237 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:32.564956 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.565628 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.565644 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.565646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.565768 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.566142 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.566149 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.566152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.566483 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:32.566805 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:32.567140 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 18:35:32.567395 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":302,"threads_started":1}
I20260810 18:35:32.569069 20509 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:32.651558 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 20371
I20260810 18:35:32.672653 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 20519
Aug 10 18:35:32 dist-test-slave-5k54 krb5kdc[20112](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:35:32.688604 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:32.673710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39346 (local address 127.13.139.3:43881)
0810 18:35:32.674417 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:32.674424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:32.674462 (+ 38us) server_negotiation.cc:407] Connection header received
0810 18:35:32.674527 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:32.674533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:32.674741 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:32.674870 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:32.676243 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.677242 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.678480 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:32.679102 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:32.679200 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:32.683026 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:32.683037 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:32.683051 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:32.683085 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:32.686047 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.686658 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.686665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.686667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.686785 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:32.687118 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:32.687121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:32.687124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:32.687536 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:32.687806 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:32.688022 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 18:35:32.688279 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":395,"threads_started":1}
I20260810 18:35:32.689881 20658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:32.773780 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 20519
I20260810 18:35:32.793071 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 20125
I20260810 18:35:32.794306 20193 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:32.901140 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 20125
2026-08-10T18:35:32Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4068 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:33 dist-test-slave-5k54 krb5kdc[20693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:33 dist-test-slave-5k54 krb5kdc[20693](info): set up 2 sockets
Aug 10 18:35:33 dist-test-slave-5k54 krb5kdc[20693](info): commencing operation
krb5kdc: starting...
W20260810 18:35:34.089983 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:34 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:34Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab.
Entry for principal oryx/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab.
I20260810 18:35:34.330695 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:39197
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab
--principal=oryx/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:39197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:34.659994 20706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:34.660332 20706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:34.660509 20706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:34.667577 20706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:34.667718 20706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:34.667834 20706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:34.667941 20706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:34.668030 20706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:34.677652 20706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:39197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab
--principal=oryx/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:39197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:34.678953 20706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:34.680281 20706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:34.692214 20714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:34.692193 20712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:34.692690 20711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:34.692950 20706 server_base.cc:1034] running on GCE node
I20260810 18:35:34.693739 20706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:34.695065 20706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:34.696288 20706 hybrid_clock.cc:648] HybridClock initialized: now 1786386934696252 us; error 55 us; skew 500 ppm
I20260810 18:35:34.696641 20706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:34 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:34.699846 20706 init.cc:377] Logged in from keytab as oryx/127.13.139.62@KRBTEST.COM (short username oryx)
I20260810 18:35:34.701368 20706 webserver.cc:460] Webserver started at http://127.13.139.62:41789/ using document root <none> and password file <none>
I20260810 18:35:34.702071 20706 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:34.702222 20706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:34.702535 20706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:34.705646 20706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "75497e66da0f43bfb17a45857c6a90e3"
format_stamp: "Formatted at 2026-08-10 18:35:34 on dist-test-slave-5k54"
server_key: "6012215f7250515815781fa91dd0dca5"
server_key_iv: "26a7392cdd502ab5eeaf39187e3d10a3"
server_key_version: "encryptionkey@0"
I20260810 18:35:34.706425 20706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "75497e66da0f43bfb17a45857c6a90e3"
format_stamp: "Formatted at 2026-08-10 18:35:34 on dist-test-slave-5k54"
server_key: "6012215f7250515815781fa91dd0dca5"
server_key_iv: "26a7392cdd502ab5eeaf39187e3d10a3"
server_key_version: "encryptionkey@0"
I20260810 18:35:34.711628 20706 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260810 18:35:34.714888 20721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:34.716204 20706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:34.716383 20706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "75497e66da0f43bfb17a45857c6a90e3"
format_stamp: "Formatted at 2026-08-10 18:35:34 on dist-test-slave-5k54"
server_key: "6012215f7250515815781fa91dd0dca5"
server_key_iv: "26a7392cdd502ab5eeaf39187e3d10a3"
server_key_version: "encryptionkey@0"
I20260810 18:35:34.716593 20706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:34.732648 20706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:34.736987 20706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:34.737280 20706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:34.755878 20706 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:39197
I20260810 18:35:34.755915 20779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:39197 every 8 connection(s)
I20260810 18:35:34.757252 20706 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:34.760869 20780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:34.762385 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 20706
I20260810 18:35:34.762612 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:34.763279 13868 external_mini_cluster.cc:1428] Setting key 4a380b75587a7b723f52358337faf68f
I20260810 18:35:34.772960 20780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: Bootstrap starting.
I20260810 18:35:34.776844 20780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: Neither blocks nor log segments found. Creating new log.
Aug 10 18:35:34 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:34.778020 20780 log.cc:824] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:34.780864 20780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: No bootstrap required, opened a new log
I20260810 18:35:34.786314 20784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:34.765325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36742 (local address 127.13.139.62:39197)
0810 18:35:34.766123 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:34.766134 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:34.766174 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:35:34.767858 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:34.767880 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:34.768231 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:34.768538 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:34.770327 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:34.771699 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:34.773424 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:34.774064 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:34.774186 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:34.778986 (+ 4800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:34.778994 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:34.779011 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:34.779053 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:34.782261 (+ 3208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:34.782988 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:34.782995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:34.783000 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:34.783164 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:34.783628 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:34.783634 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:34.783639 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:34.784150 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:34.784478 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:34.784934 (+ 456us) server_negotiation.cc:299] Negotiation successful
0810 18:35:34.785347 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":379,"threads_started":1}
I20260810 18:35:34.788637 20780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } }
I20260810 18:35:34.789068 20780 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:34.789180 20780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75497e66da0f43bfb17a45857c6a90e3, State: Initialized, Role: FOLLOWER
I20260810 18:35:34.789676 20780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } }
I20260810 18:35:34.789866 20780 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:34.789974 20780 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:34.790086 20780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:34.792500 20780 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } }
I20260810 18:35:34.792924 20780 leader_election.cc:302] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75497e66da0f43bfb17a45857c6a90e3; no voters:
I20260810 18:35:34.793414 20780 leader_election.cc:288] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:34.793557 20786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:34.794265 20786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 1 LEADER]: Becoming Leader. State: Replica: 75497e66da0f43bfb17a45857c6a90e3, State: Running, Role: LEADER
I20260810 18:35:34.794802 20786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } }
I20260810 18:35:34.795365 20780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:34.797480 20788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75497e66da0f43bfb17a45857c6a90e3. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } }
I20260810 18:35:34.797822 20788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:34.800355 20787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } }
I20260810 18:35:34.800750 20787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:34.801607 20794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:34.806494 20794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:34.814486 20794 catalog_manager.cc:1347] Generated new cluster ID: 3dae4da720d4462392e7b6458fbd6ab0
I20260810 18:35:34.814605 20794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:34.823613 20794 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:34.824877 20794 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:34.831303 20794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: Generated new TSK 0
I20260810 18:35:34.832144 20794 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab.
Entry for principal oryx/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab.
I20260810 18:35:34.899645 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:39197
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab
--principal=oryx/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:35.234788 20810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:35.235069 20810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:35.235226 20810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:35.242794 20810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:35.242901 20810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:35.243096 20810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:35.253054 20810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab
--principal=oryx/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:39197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:35.254364 20810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:35.255781 20810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:35.268877 20815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:35.268977 20818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:35.268988 20816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:35.269786 20810 server_base.cc:1034] running on GCE node
I20260810 18:35:35.270448 20810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:35.271478 20810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:35.272715 20810 hybrid_clock.cc:648] HybridClock initialized: now 1786386935272670 us; error 46 us; skew 500 ppm
I20260810 18:35:35.273070 20810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:35 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386935, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:35.276605 20810 init.cc:377] Logged in from keytab as oryx/127.13.139.1@KRBTEST.COM (short username oryx)
I20260810 18:35:35.277990 20810 webserver.cc:460] Webserver started at http://127.13.139.1:45175/ using document root <none> and password file <none>
I20260810 18:35:35.278656 20810 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:35.278759 20810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:35.279019 20810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:35.282047 20810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "26022dbf3568467c983382d03b554443"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "89f3b7a62813a21c42726c75dcdc8bfa"
server_key_iv: "a75c5f48a3feff1ab97791c30e69042f"
server_key_version: "encryptionkey@0"
I20260810 18:35:35.282949 20810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "26022dbf3568467c983382d03b554443"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "89f3b7a62813a21c42726c75dcdc8bfa"
server_key_iv: "a75c5f48a3feff1ab97791c30e69042f"
server_key_version: "encryptionkey@0"
I20260810 18:35:35.288568 20810 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260810 18:35:35.292158 20825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:35.293500 20810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:35:35.293677 20810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "26022dbf3568467c983382d03b554443"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "89f3b7a62813a21c42726c75dcdc8bfa"
server_key_iv: "a75c5f48a3feff1ab97791c30e69042f"
server_key_version: "encryptionkey@0"
I20260810 18:35:35.293879 20810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:35.322520 20810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:35.327134 20810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:35.327497 20810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:35.328510 20810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:35.329873 20810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:35.329945 20810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:35.330091 20810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:35.330178 20810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:35.364046 20810 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:40703
I20260810 18:35:35.364128 20946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:40703 every 8 connection(s)
I20260810 18:35:35.365352 20810 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:35.375111 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 20810
I20260810 18:35:35.375362 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:35.376144 13868 external_mini_cluster.cc:1428] Setting key a3d99d8c023988366858465ff6f6a1d0
Aug 10 18:35:35 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386935, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:35.385716 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:35.367951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:50801 (local address 127.13.139.62:39197)
0810 18:35:35.368439 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:35.368443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:35.369153 (+ 710us) server_negotiation.cc:407] Connection header received
0810 18:35:35.371021 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:35.371027 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:35.371119 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:35.371243 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:35.372757 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.373497 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.375474 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.375893 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.376005 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:35.380061 (+ 4056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:35.380066 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:35.380070 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:35.380102 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:35.382667 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:35.383382 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:35.383388 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:35.383394 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:35.383572 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:35.384004 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:35.384011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:35.384015 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:35.384280 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:35.384440 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:35.385124 (+ 684us) server_negotiation.cc:299] Negotiation successful
0810 18:35:35.385359 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":258,"threads_started":1}
I20260810 18:35:35.386650 20950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:35.368268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.1:50801)
0810 18:35:35.368986 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:35.369025 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:35.370745 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:35.371534 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:35.371542 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:35.372043 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:35.372583 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:35.372599 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.373666 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.373689 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:35.375276 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:35.375291 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.376142 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.376150 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:35.376457 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:35.377393 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:35.377420 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:35.379835 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:35.382809 (+ 2974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:35.382818 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:35.382834 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:35.383256 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:35.383684 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:35.383689 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:35.383693 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:35.383891 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:35.384419 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:35.384426 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:35.384740 (+ 314us) client_negotiation.cc:769] Sending connection context
0810 18:35:35.385021 (+ 281us) client_negotiation.cc:240] Negotiation successful
0810 18:35:35.385525 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":298,"threads_started":1}
I20260810 18:35:35.388259 20947 heartbeater.cc:347] Connected to a master server at 127.13.139.62:39197
I20260810 18:35:35.388607 20947 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:35.389479 20947 heartbeater.cc:511] Master 127.13.139.62:39197 requested a full tablet report, sending...
I20260810 18:35:35.391779 20741 ts_manager.cc:194] Registered new tserver with Master: 26022dbf3568467c983382d03b554443 (127.13.139.1:40703)
I20260810 18:35:35.393283 20741 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:50801
WARNING: no policy specified for oryx/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab.
Entry for principal oryx/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab.
I20260810 18:35:35.434723 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:39197
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab
--principal=oryx/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:35.780237 20953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:35.780526 20953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:35.780623 20953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:35.788035 20953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:35.788151 20953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:35.788271 20953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:35.798554 20953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab
--principal=oryx/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:39197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:35.799906 20953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:35.801177 20953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:35.814329 20961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:35.814528 20958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:35.814329 20959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:35.815209 20953 server_base.cc:1034] running on GCE node
I20260810 18:35:35.815897 20953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:35.816799 20953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:35.818003 20953 hybrid_clock.cc:648] HybridClock initialized: now 1786386935817957 us; error 41 us; skew 500 ppm
I20260810 18:35:35.818326 20953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:35 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386935, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:35.821897 20953 init.cc:377] Logged in from keytab as oryx/127.13.139.2@KRBTEST.COM (short username oryx)
I20260810 18:35:35.823412 20953 webserver.cc:460] Webserver started at http://127.13.139.2:35255/ using document root <none> and password file <none>
I20260810 18:35:35.824179 20953 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:35.824316 20953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:35.824651 20953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:35.828168 20953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "c76195126ba54f8387f1c92b6084e738"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "a35c8d8d676ee65bd66b32d357911d6d"
server_key_iv: "7335b2776d39bc72d247adce0424f04e"
server_key_version: "encryptionkey@0"
I20260810 18:35:35.828969 20953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "c76195126ba54f8387f1c92b6084e738"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "a35c8d8d676ee65bd66b32d357911d6d"
server_key_iv: "7335b2776d39bc72d247adce0424f04e"
server_key_version: "encryptionkey@0"
I20260810 18:35:35.834262 20953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:35:35.837808 20968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:35.839207 20953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:35.839395 20953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "c76195126ba54f8387f1c92b6084e738"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "a35c8d8d676ee65bd66b32d357911d6d"
server_key_iv: "7335b2776d39bc72d247adce0424f04e"
server_key_version: "encryptionkey@0"
I20260810 18:35:35.839689 20953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:35.857110 20953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:35.861438 20953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:35.861754 20953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:35.862764 20953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:35.864355 20953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:35.864462 20953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:35.864615 20953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:35.864689 20953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:35.899272 20953 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:45629
I20260810 18:35:35.899322 21094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:45629 every 8 connection(s)
I20260810 18:35:35.900580 20953 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:35.901104 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 20953
I20260810 18:35:35.901366 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:35.902038 13868 external_mini_cluster.cc:1428] Setting key 8976a7a74d44cc71fc4118f97dbb3747
Aug 10 18:35:35 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386935, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:35.926286 21097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:35.903663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:41399 (local address 127.13.139.62:39197)
0810 18:35:35.904115 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:35.904121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:35.905026 (+ 905us) server_negotiation.cc:407] Connection header received
0810 18:35:35.906875 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:35.906881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:35.906976 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:35.907092 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:35.908645 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.909381 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.910898 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.911310 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.911465 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:35.919762 (+ 8297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:35.919768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:35.919771 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:35.919817 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:35.922538 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:35.923608 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:35.923612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:35.923615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:35.923762 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:35.924350 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:35.924354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:35.924356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:35.924648 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:35.924787 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:35.925839 (+ 1052us) server_negotiation.cc:299] Negotiation successful
0810 18:35:35.926025 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":215,"threads_started":1}
I20260810 18:35:35.927991 21098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:35.904085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.2:41399)
0810 18:35:35.904874 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:35.904919 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:35.906611 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:35.907326 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:35.907334 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:35.907919 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:35.908480 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:35.908497 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.909544 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.909550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:35.910755 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:35.910767 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:35.911594 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:35.911605 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:35.911817 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:35.916221 (+ 4404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:35.916269 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:35.919458 (+ 3189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:35.922693 (+ 3235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:35.922705 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:35.922726 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:35.923413 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:35.923895 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:35.923902 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:35.923905 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:35.924180 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:35.924808 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:35.924820 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:35.925378 (+ 558us) client_negotiation.cc:769] Sending connection context
0810 18:35:35.925755 (+ 377us) client_negotiation.cc:240] Negotiation successful
0810 18:35:35.926380 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":337,"threads_started":1}
WARNING: no policy specified for oryx/127.13.139.3@KRBTEST.COM; defaulting to no policy
I20260810 18:35:35.929628 21095 heartbeater.cc:347] Connected to a master server at 127.13.139.62:39197
I20260810 18:35:35.929967 21095 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:35.930734 21095 heartbeater.cc:511] Master 127.13.139.62:39197 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.3@KRBTEST.COM" created.
I20260810 18:35:35.932330 20741 ts_manager.cc:194] Registered new tserver with Master: c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629)
I20260810 18:35:35.933228 20741 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:41399
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab.
Entry for principal oryx/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab.
I20260810 18:35:35.962144 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:39197
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab
--principal=oryx/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:36.291069 21102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:36.291337 21102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:36.291493 21102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:36.299173 21102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:36.299280 21102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:36.299410 21102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:36.309505 21102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab
--principal=oryx/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:39197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:36.310726 21102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:36.312052 21102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:36.325110 21109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:36.325032 21110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:36.325074 21112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:36.326123 21102 server_base.cc:1034] running on GCE node
I20260810 18:35:36.326754 21102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:36.327785 21102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:36.328997 21102 hybrid_clock.cc:648] HybridClock initialized: now 1786386936328958 us; error 39 us; skew 500 ppm
I20260810 18:35:36.329304 21102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:36 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386936, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:36.332485 21102 init.cc:377] Logged in from keytab as oryx/127.13.139.3@KRBTEST.COM (short username oryx)
I20260810 18:35:36.333835 21102 webserver.cc:460] Webserver started at http://127.13.139.3:39139/ using document root <none> and password file <none>
I20260810 18:35:36.334486 21102 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:36.334586 21102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:36.334830 21102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:36.337697 21102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "00d6393d56f04094a68320314fca78a9"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "f423d8f271e1f7bcf123f9afaa0459ae"
server_key_iv: "846b96e4e8c59902bf3bd94606fc9255"
server_key_version: "encryptionkey@0"
I20260810 18:35:36.338426 21102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "00d6393d56f04094a68320314fca78a9"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "f423d8f271e1f7bcf123f9afaa0459ae"
server_key_iv: "846b96e4e8c59902bf3bd94606fc9255"
server_key_version: "encryptionkey@0"
I20260810 18:35:36.343605 21102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260810 18:35:36.347107 21120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:36.348431 21102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:36.348608 21102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "00d6393d56f04094a68320314fca78a9"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "f423d8f271e1f7bcf123f9afaa0459ae"
server_key_iv: "846b96e4e8c59902bf3bd94606fc9255"
server_key_version: "encryptionkey@0"
I20260810 18:35:36.348814 21102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:36.369649 21102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:36.373613 21102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:36.373899 21102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:36.374873 21102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:36.376304 21102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:36.376382 21102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:36.376607 21102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:36.376665 21102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:36.397285 20947 heartbeater.cc:503] Master 127.13.139.62:39197 was elected leader, sending a full tablet report...
I20260810 18:35:36.410081 21102 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:34279
I20260810 18:35:36.410174 21244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:34279 every 8 connection(s)
I20260810 18:35:36.411413 21102 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:36.415843 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 21102
I20260810 18:35:36.416035 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:36.416481 13868 external_mini_cluster.cc:1428] Setting key de09f2d85bcbdd96db09d385802e7384
Aug 10 18:35:36 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386936, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:36.432163 21097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:36.414125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:35287 (local address 127.13.139.62:39197)
0810 18:35:36.414303 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:36.414308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:36.415487 (+ 1179us) server_negotiation.cc:407] Connection header received
0810 18:35:36.417749 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:36.417758 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:36.417859 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:36.417968 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:36.419905 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.420787 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.422341 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.422729 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.422821 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:36.426082 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:36.426087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:36.426090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:36.426123 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:36.429011 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:36.429650 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:36.429654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:36.429656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:36.429771 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:36.430161 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:36.430173 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:36.430176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:36.430545 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:36.430675 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:36.431601 (+ 926us) server_negotiation.cc:299] Negotiation successful
0810 18:35:36.431792 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:35:36.433199 21247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:36.414568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:35287)
0810 18:35:36.415284 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:36.415327 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:36.417415 (+ 2088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:36.418169 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:36.418177 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:36.418923 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:36.419751 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:36.419777 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.420915 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.420919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:36.422221 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:36.422233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.422921 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.422925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:36.423115 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:36.423781 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:36.423802 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:36.425891 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:36.429123 (+ 3232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:36.429129 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:36.429141 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:36.429546 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:36.429857 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:36.429860 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:36.429862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:36.430034 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:36.430684 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:36.430692 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:36.431105 (+ 413us) client_negotiation.cc:769] Sending connection context
0810 18:35:36.431458 (+ 353us) client_negotiation.cc:240] Negotiation successful
0810 18:35:36.432017 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":278,"threads_started":1}
I20260810 18:35:36.434607 21245 heartbeater.cc:347] Connected to a master server at 127.13.139.62:39197
I20260810 18:35:36.434922 21245 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:36.435681 21245 heartbeater.cc:511] Master 127.13.139.62:39197 requested a full tablet report, sending...
I20260810 18:35:36.437062 20741 ts_manager.cc:194] Registered new tserver with Master: 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279)
I20260810 18:35:36.437865 20741 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:35287
I20260810 18:35:36.444267 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.139.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.61.keytab.
Entry for principal oryx/127.13.139.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.61.keytab.
I20260810 18:35:36.503333 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:37515
--webserver_interface=127.13.139.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.61.keytab
--principal=oryx/127.13.139.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:39197,127.13.139.61:37515
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:36.849624 21250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:36.850013 21250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:36.850195 21250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:36.858862 21250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:36.859035 21250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:36.859154 21250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:36.859261 21250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:36.859345 21250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:36.870569 21250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:39197,127.13.139.61:37515
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.61.keytab
--principal=oryx/127.13.139.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:37515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.139.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
W20260810 18:35:36.871042 21250 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.13.139.62:39197,127.13.139.61:37515'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 18:35:36.872714 21250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:36.874567 21250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:36.887437 21259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:36.887483 21256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:36.887508 21255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:36.888386 21250 server_base.cc:1034] running on GCE node
I20260810 18:35:36.889199 21250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:36.890604 21250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:36.891853 21250 hybrid_clock.cc:648] HybridClock initialized: now 1786386936891740 us; error 76 us; skew 500 ppm
I20260810 18:35:36.892208 21250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:36 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386936, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:36.895902 21250 init.cc:377] Logged in from keytab as oryx/127.13.139.61@KRBTEST.COM (short username oryx)
I20260810 18:35:36.897681 21250 webserver.cc:460] Webserver started at http://127.13.139.61:42153/ using document root <none> and password file <none>
I20260810 18:35:36.898590 21250 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:36.898741 21250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:36.899137 21250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:36.903666 21250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/instance:
uuid: "5d10378a66d64da690b1345a896b6c61"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "ca47a0a19a65541981ccdfe13765f50d"
server_key_iv: "30f3e806f69087aa490d715a247d001c"
server_key_version: "encryptionkey@0"
I20260810 18:35:36.904759 21250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal/instance:
uuid: "5d10378a66d64da690b1345a896b6c61"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "ca47a0a19a65541981ccdfe13765f50d"
server_key_iv: "30f3e806f69087aa490d715a247d001c"
server_key_version: "encryptionkey@0"
I20260810 18:35:36.910861 21250 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260810 18:35:36.914673 21268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:36.916163 21250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:36.916361 21250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
uuid: "5d10378a66d64da690b1345a896b6c61"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "ca47a0a19a65541981ccdfe13765f50d"
server_key_iv: "30f3e806f69087aa490d715a247d001c"
server_key_version: "encryptionkey@0"
I20260810 18:35:36.916589 21250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:36.934083 21250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:36.935925 21095 heartbeater.cc:503] Master 127.13.139.62:39197 was elected leader, sending a full tablet report...
I20260810 18:35:36.938755 21250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:36.939013 21250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:36.958115 21250 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.61:37515
I20260810 18:35:36.958134 21325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.61:37515 every 8 connection(s)
I20260810 18:35:36.959589 21250 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
I20260810 18:35:36.963227 21326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:36.967978 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 21250
I20260810 18:35:36.970741 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:35:36 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.61@KRBTEST.COM
Aug 10 18:35:36 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386936, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.61@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:36.991966 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:36.975031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36754 (local address 127.13.139.62:39197)
0810 18:35:36.976113 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:36.976117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:36.977495 (+ 1378us) server_negotiation.cc:407] Connection header received
0810 18:35:36.977697 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:36.977701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:36.977775 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:36.977860 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:36.979283 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.980110 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.981469 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.981880 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.982024 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:36.985602 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:36.985612 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:36.985617 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:36.985660 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:36.988984 (+ 3324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:36.989713 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:36.989719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:36.989722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:36.989862 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:36.990294 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:36.990297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:36.990299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:36.990727 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:36.990868 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:36.991346 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 18:35:36.991613 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":983,"thread_start_us":854,"threads_started":1}
I20260810 18:35:36.992348 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:36.970383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38312 (local address 127.13.139.61:37515)
0810 18:35:36.971216 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:36.971232 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:36.971273 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:35:36.972918 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:36.972949 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:36.973380 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:36.973745 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:36.975422 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.977193 (+ 1771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.978987 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.979698 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.979883 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:36.984262 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:36.984269 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:36.984280 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:36.984313 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:36.987947 (+ 3634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:36.988621 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:36.988633 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:36.988642 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:36.988833 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:36.989249 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:36.989253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:36.989255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:36.989860 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:36.990133 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:36.990631 (+ 498us) server_negotiation.cc:299] Negotiation successful
0810 18:35:36.991041 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":394,"threads_started":1}
I20260810 18:35:36.992399 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:36.974988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:36754)
0810 18:35:36.977327 (+ 2339us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:36.977375 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:36.977559 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:36.977961 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:36.977970 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:36.978784 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:36.979131 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:36.979142 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.980249 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.980254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:36.981282 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:36.981293 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.982107 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.982115 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:36.982287 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:36.982874 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:36.982902 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:36.985397 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:36.989105 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:36.989118 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:36.989124 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:36.989595 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:36.989994 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:36.989998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:36.990002 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:36.990181 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:36.990905 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:36.990919 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:36.991064 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 18:35:36.991219 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 18:35:36.991499 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":369,"threads_started":1}
I20260810 18:35:36.994401 21326 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:35:36 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386936, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.61@KRBTEST.COM for oryx/127.13.139.61@KRBTEST.COM
I20260810 18:35:37.006668 21330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:36.995334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.0.0.1:38328)
0810 18:35:36.995525 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:36.995540 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:36.995654 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:36.995955 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:36.995959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:36.996321 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:36.996459 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:36.996468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.997550 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.997555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:36.998504 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:36.998515 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.999190 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.999195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:36.999366 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:36.999938 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:36.999955 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.001914 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.004713 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.004717 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.004719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.005111 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.005414 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.005417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.005420 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.005547 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.005994 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.005997 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.006115 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.006218 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.006414 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 18:35:37.006896 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:36.995260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.13.139.61:37515)
0810 18:35:36.995458 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:36.995465 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:36.995600 (+ 135us) server_negotiation.cc:407] Connection header received
0810 18:35:36.995766 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:36.995771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:36.995836 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:36.995931 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:36.996582 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.997415 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.998646 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:36.999055 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:36.999185 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.002117 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.002122 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.002125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.002152 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.004598 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.005213 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.005216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.005218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.005321 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.005635 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.005638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.005640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.005897 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.006003 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.006298 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.006555 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":53}
I20260810 18:35:37.011583 21326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Bootstrap starting.
I20260810 18:35:37.014547 21326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:37.015589 21326 log.cc:824] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:37.018088 21326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: No bootstrap required, opened a new log
I20260810 18:35:37.025264 21326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } }
I20260810 18:35:37.025560 21326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:37.025635 21326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d10378a66d64da690b1345a896b6c61, State: Initialized, Role: FOLLOWER
I20260810 18:35:37.026124 21326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } }
I20260810 18:35:37.026880 21333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } } }
I20260810 18:35:37.027168 21333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:37.027961 21326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 18:35:37.037009 21345 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:35:37.037139 21345 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:35:37.039783 21250 master_runner.cc:428] Detected that this master 5d10378a66d64da690b1345a896b6c61 is joining an existing cluster
I20260810 18:35:37.039870 21250 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.139.61:37515
I20260810 18:35:37.058122 21333 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:37.058455 21333 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } }
I20260810 18:35:37.060227 21333 leader_election.cc:288] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197)
I20260810 18:35:37.061015 20753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d10378a66d64da690b1345a896b6c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75497e66da0f43bfb17a45857c6a90e3" is_pre_election: true
I20260810 18:35:37.062346 21269 leader_election.cc:302] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 5d10378a66d64da690b1345a896b6c61; no voters: 75497e66da0f43bfb17a45857c6a90e3
I20260810 18:35:37.063104 21333 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 18:35:37.063418 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.043847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36770 (local address 127.13.139.62:39197)
0810 18:35:37.044066 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.044072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.044863 (+ 791us) server_negotiation.cc:407] Connection header received
0810 18:35:37.045118 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.045124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.045243 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.045354 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.046881 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.048043 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.050126 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.050782 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.050884 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.053848 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.053855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.053862 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.053906 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.057666 (+ 3760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.059953 (+ 2287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.059961 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.059968 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.060142 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.060700 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.060708 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.060712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.061117 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.061257 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.062726 (+ 1469us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.063008 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 18:35:37.064364 21351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.043949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:36770)
0810 18:35:37.044720 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.044742 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.044961 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.045575 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.045580 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.046258 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.046690 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.046705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.048225 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.048230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.049951 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.049966 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.051214 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.051221 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.051510 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.052215 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.052239 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.053638 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.059292 (+ 5654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.059297 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.059301 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.059796 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.060307 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.060314 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.060384 (+ 70us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.060559 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.061473 (+ 914us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.061481 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.061685 (+ 204us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.063518 (+ 1833us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.063862 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":440,"threads_started":1}
I20260810 18:35:37.073477 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.044347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.13.139.61:37515)
0810 18:35:37.044564 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.044571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.051482 (+ 6911us) server_negotiation.cc:407] Connection header received
0810 18:35:37.051875 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.051883 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.051955 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.052019 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.053751 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.055239 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.057479 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.058353 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.058484 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.064468 (+ 5984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.064474 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.064479 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.064520 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.069340 (+ 4820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.070244 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.070251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.070257 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.070422 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.071783 (+ 1361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.071788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.071792 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.072177 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.072336 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.072854 (+ 518us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.073132 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 18:35:37.074724 21352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.044141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.0.0.1:38332)
0810 18:35:37.051347 (+ 7206us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.051370 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.051747 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.052213 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.052220 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.053147 (+ 927us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.053601 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.053621 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.055481 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.055488 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.057274 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.057291 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.061997 (+ 4706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.062005 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.062190 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.062862 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.062883 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.064248 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.069494 (+ 5246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.069501 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.069508 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.070130 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.070558 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.070565 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.070571 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.071661 (+ 1090us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.072401 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.072406 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.072558 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.073936 (+ 1378us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.074280 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7045,"thread_start_us":7340,"threads_started":1}
WARNING: no policy specified for oryx/127.13.139.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.60@KRBTEST.COM" created.
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.62@KRBTEST.COM for oryx/127.13.139.61@KRBTEST.COM
I20260810 18:35:37.100225 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.072527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.0.0.1:38348)
0810 18:35:37.080310 (+ 7783us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.080366 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.081551 (+ 1185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.082069 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.082078 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.083026 (+ 948us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.083333 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.083346 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.084584 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.084590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.086343 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.086363 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.087490 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.087500 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.087752 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.088561 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.088596 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.091983 (+ 3387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.096936 (+ 4953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.096951 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.096960 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.097504 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.097944 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.097950 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.097954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.098123 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.098770 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.098779 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.099014 (+ 235us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.099222 (+ 208us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.099654 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7510,"thread_start_us":7376,"threads_started":1}
I20260810 18:35:37.100298 21329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.072904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38348 (local address 127.13.139.61:37515)
0810 18:35:37.073895 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.073900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.081420 (+ 7520us) server_negotiation.cc:407] Connection header received
0810 18:35:37.081804 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.081808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.081881 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.081967 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.083549 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.084441 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.086525 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.087262 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.087402 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.092196 (+ 4794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.092205 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.092212 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.092258 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.096783 (+ 4525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.097639 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.097645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.097649 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.097837 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.098326 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.098330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.098332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.098632 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.098790 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.099653 (+ 863us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.099891 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":877,"thread_start_us":6724,"threads_started":1}
I20260810 18:35:37.102852 20741 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.139.61:37515: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5d10378a66d64da690b1345a896b6c61"
member_type: NON_VOTER
last_known_addr {
host: "127.13.139.61"
port: 37515
}
attrs {
promote: true
}
}
dest_uuid: "75497e66da0f43bfb17a45857c6a90e3"
cas_config_opid_index: -1
I20260810 18:35:37.104729 20741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } }
I20260810 18:35:37.119752 21299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:37.120482 21359 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5d10378a66d64da690b1345a896b6c61 (127.13.139.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.124342 21299 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Refusing update from remote peer 75497e66da0f43bfb17a45857c6a90e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 18:35:37.125391 21360 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.60.keytab.
Entry for principal oryx/127.13.139.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.60.keytab.
I20260810 18:35:37.131156 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:33907
--webserver_interface=127.13.139.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.60.keytab
--principal=oryx/127.13.139.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:35:37.133631 21359 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.139.61:37515
I20260810 18:35:37.134732 21250 master.cc:537] Master@127.13.139.61:37515 shutting down...
I20260810 18:35:37.136214 21360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.136478 21360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:37.157150 21299 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5d10378a66d64da690b1345a896b6c61 (127.13.139.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.184052 21366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.184402 21366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: LEARNER
I20260810 18:35:37.184640 21366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.184827 21366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: LEARNER
I20260810 18:35:37.185086 21333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75497e66da0f43bfb17a45857c6a90e3. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.185259 21333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: LEARNER
I20260810 18:35:37.187039 21250 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 LEARNER]: Raft consensus shutting down.
I20260810 18:35:37.187592 21250 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 LEARNER]: Raft consensus is shut down!
I20260810 18:35:37.187765 21250 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: stopping tablet replica
I20260810 18:35:37.196874 21250 master.cc:552] Master@127.13.139.61:37515 shutdown complete.
I20260810 18:35:37.197017 21250 master_runner.cc:305] Clearing existing system tablet
I20260810 18:35:37.197494 21250 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:37.197595 21250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:37.200965 21250 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 18:35:37.202771 21373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:37.203313 21250 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:37.203938 21250 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 18:35:37.204084 21250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
uuid: "5d10378a66d64da690b1345a896b6c61"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "ca47a0a19a65541981ccdfe13765f50d"
server_key_iv: "30f3e806f69087aa490d715a247d001c"
server_key_version: "encryptionkey@0"
I20260810 18:35:37.209033 21250 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:37.216150 21250 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 18:35:37.216437 21250 log.cc:1196] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 18:35:37.217049 21250 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Deleting consensus metadata
I20260810 18:35:37.217370 21250 master_runner.cc:315] Copying system tablet from 127.13.139.62:39197
I20260810 18:35:37.220449 21250 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: tablet copy: Beginning tablet copy session from remote peer at address 127.13.139.62:39197
I20260810 18:35:37.237371 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.221729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36786 (local address 127.13.139.62:39197)
0810 18:35:37.221954 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.221961 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.222514 (+ 553us) server_negotiation.cc:407] Connection header received
0810 18:35:37.222740 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.222746 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.222836 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.222957 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.224072 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.225231 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.227164 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.227875 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.228021 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.230491 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.230498 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.230503 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.230545 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.234178 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.234991 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.234996 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.235000 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.235154 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.235658 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.235663 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.235667 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.236055 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.236217 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.236739 (+ 522us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.236985 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 18:35:37.238018 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.221625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:36786)
0810 18:35:37.222383 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.222403 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.222563 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.223001 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.223006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.223580 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.223904 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.223917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.225406 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.225413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.227002 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.227017 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.228054 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.228061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.228230 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.229008 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.229033 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.230284 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.234329 (+ 4045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.234337 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.234342 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.234855 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.235286 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.235292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.235296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.235534 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.236215 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.236222 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.236436 (+ 214us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.236627 (+ 191us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.237025 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":473,"threads_started":1}
I20260810 18:35:37.239065 20763 tablet_copy_service.cc:140] P 75497e66da0f43bfb17a45857c6a90e3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5d10378a66d64da690b1345a896b6c61 ({username='oryx', principal='oryx/127.13.139.61@KRBTEST.COM'} at 127.0.0.1:36786)
I20260810 18:35:37.239485 20763 tablet_copy_service.cc:161] P 75497e66da0f43bfb17a45857c6a90e3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5d10378a66d64da690b1345a896b6c61 at {username='oryx', principal='oryx/127.13.139.61@KRBTEST.COM'} at 127.0.0.1:36786: session id = 5d10378a66d64da690b1345a896b6c61-00000000000000000000000000000000
I20260810 18:35:37.244267 20763 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 18:35:37.247033 21250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 18:35:37.254114 21250 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: tablet copy: Starting download of 0 data blocks...
I20260810 18:35:37.254499 21250 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: tablet copy: Starting download of 1 WAL segments...
I20260810 18:35:37.258365 21250 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 18:35:37.263115 20763 tablet_copy_service.cc:342] P 75497e66da0f43bfb17a45857c6a90e3: Request end of tablet copy session 5d10378a66d64da690b1345a896b6c61-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.139.61@KRBTEST.COM'} at 127.0.0.1:36786
I20260810 18:35:37.263360 20763 tablet_copy_service.cc:433] P 75497e66da0f43bfb17a45857c6a90e3: ending tablet copy session 5d10378a66d64da690b1345a896b6c61-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5d10378a66d64da690b1345a896b6c61
I20260810 18:35:37.276479 21250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:37.279304 21382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:37.285256 21383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:37.289316 21386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:37.289634 21250 server_base.cc:1034] running on GCE node
I20260810 18:35:37.290035 21250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:37.290680 21250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:37.291926 21250 hybrid_clock.cc:648] HybridClock initialized: now 1786386937291834 us; error 35 us; skew 500 ppm
I20260810 18:35:37.292176 21250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386937, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:37.294056 21250 init.cc:377] Logged in from keytab as oryx/127.13.139.61@KRBTEST.COM (short username oryx)
I20260810 18:35:37.295490 21250 webserver.cc:460] Webserver started at http://127.13.139.61:43417/ using document root <none> and password file <none>
I20260810 18:35:37.295857 21250 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:37.295953 21250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:37.298529 21250 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 18:35:37.300468 21393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:37.300848 21250 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 18:35:37.301074 21250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
uuid: "5d10378a66d64da690b1345a896b6c61"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "ca47a0a19a65541981ccdfe13765f50d"
server_key_iv: "30f3e806f69087aa490d715a247d001c"
server_key_version: "encryptionkey@0"
I20260810 18:35:37.301260 21250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:37.314925 21250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:37.318347 21250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:37.349982 21250 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.61:37515
I20260810 18:35:37.350021 21450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.61:37515 every 8 connection(s)
I20260810 18:35:37.350951 21250 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
I20260810 18:35:37.358296 21451 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:35:37.361011 21451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Bootstrap starting.
I20260810 18:35:37.376458 21451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:35:37.377035 21451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: Bootstrap complete.
I20260810 18:35:37.378185 21451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } }
I20260810 18:35:37.378490 21451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5d10378a66d64da690b1345a896b6c61, State: Initialized, Role: LEARNER
I20260810 18:35:37.378791 21451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } }
I20260810 18:35:37.379657 21454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.379984 21451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:37.380087 21454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: LEARNER
I20260810 18:35:37.389910 21466 catalog_manager.cc:1259] Loaded cluster ID: 3dae4da720d4462392e7b6458fbd6ab0
I20260810 18:35:37.390036 21466 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: loading cluster ID for follower catalog manager: success
I20260810 18:35:37.394608 21466 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: acquiring CA information for follower catalog manager: success
I20260810 18:35:37.397475 21466 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 18:35:37.440407 21245 heartbeater.cc:503] Master 127.13.139.62:39197 was elected leader, sending a full tablet report...
W20260810 18:35:37.549747 21365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:37.550041 21365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:37.550132 21365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:37.558045 21365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:37.558143 21365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:37.558188 21365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:37.558245 21365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:37.558288 21365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:37.559098 21359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.559393 21359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:37.566175 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.559624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38354 (local address 127.13.139.61:37515)
0810 18:35:37.560204 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.560209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.560226 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:35:37.560288 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.560291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.560365 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.560463 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:37.561008 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.561933 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.564308 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.565178 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.565275 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.565450 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.565799 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.565895 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":323,"threads_started":1}
I20260810 18:35:37.566174 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.559430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.0.0.1:38354)
0810 18:35:37.559653 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.559673 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.559805 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.560555 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.560560 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.560589 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:37.560804 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.560818 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.562096 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.562103 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.564147 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.564163 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.565363 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.565370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.565603 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.565665 (+ 62us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.565767 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.565908 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260810 18:35:37.567309 21454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75497e66da0f43bfb17a45857c6a90e3. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.567584 21454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: LEARNER
I20260810 18:35:37.568289 21359 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: attempting to promote NON_VOTER 5d10378a66d64da690b1345a896b6c61 to VOTER
I20260810 18:35:37.569061 21359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } }
I20260810 18:35:37.570720 21424 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 LEARNER]: Refusing update from remote peer 75497e66da0f43bfb17a45857c6a90e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 18:35:37.571081 21365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.60.keytab
--principal=oryx/127.13.139.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:33907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.139.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:37.571343 21360 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 18:35:37.572862 21365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:37.574350 21365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 18:35:37.574263 21359 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 5d10378a66d64da690b1345a896b6c61 (127.13.139.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } }
I20260810 18:35:37.574967 21424 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 5d10378a66d64da690b1345a896b6c61 (127.13.139.61) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } }
I20260810 18:35:37.577967 21359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } }
I20260810 18:35:37.578195 21359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:37.578666 21454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } }
I20260810 18:35:37.578902 21454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:37.579500 21360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } }
I20260810 18:35:37.579792 21360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
W20260810 18:35:37.587386 21479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:37.587567 21476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:37.587505 21477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:37.588625 21365 server_base.cc:1034] running on GCE node
I20260810 18:35:37.589372 21365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:37.590734 21365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:37.591972 21365 hybrid_clock.cc:648] HybridClock initialized: now 1786386937591922 us; error 54 us; skew 500 ppm
I20260810 18:35:37.592306 21365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386937, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:37.595606 21365 init.cc:377] Logged in from keytab as oryx/127.13.139.60@KRBTEST.COM (short username oryx)
I20260810 18:35:37.597278 21365 webserver.cc:460] Webserver started at http://127.13.139.60:46749/ using document root <none> and password file <none>
I20260810 18:35:37.597987 21365 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:37.598120 21365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:37.598491 21365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:37.601805 21365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/instance:
uuid: "e12e2a2154434cca8d7a7a758116c771"
format_stamp: "Formatted at 2026-08-10 18:35:37 on dist-test-slave-5k54"
server_key: "ce1439c61dd0439752a0f2ac8b5f3f73"
server_key_iv: "56a892a1ca6219cd4c40d4c372001e73"
server_key_version: "encryptionkey@0"
I20260810 18:35:37.602631 21365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal/instance:
uuid: "e12e2a2154434cca8d7a7a758116c771"
format_stamp: "Formatted at 2026-08-10 18:35:37 on dist-test-slave-5k54"
server_key: "ce1439c61dd0439752a0f2ac8b5f3f73"
server_key_iv: "56a892a1ca6219cd4c40d4c372001e73"
server_key_version: "encryptionkey@0"
I20260810 18:35:37.607758 21365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 18:35:37.611124 21486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:37.612587 21365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:37.612766 21365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
uuid: "e12e2a2154434cca8d7a7a758116c771"
format_stamp: "Formatted at 2026-08-10 18:35:37 on dist-test-slave-5k54"
server_key: "ce1439c61dd0439752a0f2ac8b5f3f73"
server_key_iv: "56a892a1ca6219cd4c40d4c372001e73"
server_key_version: "encryptionkey@0"
I20260810 18:35:37.612933 21365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:37.627264 21365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:37.631670 21365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:37.631949 21365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:37.650671 21365 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.60:33907
I20260810 18:35:37.650695 21543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.60:33907 every 8 connection(s)
I20260810 18:35:37.652308 21365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
I20260810 18:35:37.656252 21544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:37.659293 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 21365
I20260810 18:35:37.664162 21544 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.60@KRBTEST.COM
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386937, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.60@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:37.683768 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.667122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36794 (local address 127.13.139.62:39197)
0810 18:35:37.667326 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.667332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.667807 (+ 475us) server_negotiation.cc:407] Connection header received
0810 18:35:37.668018 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.668023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.668097 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.668213 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.669682 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.670630 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.672481 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.672922 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.673025 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.676965 (+ 3940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.676970 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.676973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.677005 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.680398 (+ 3393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.681459 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.681463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.681465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.681596 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.682022 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.682027 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.682029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.682381 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.682532 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.683186 (+ 654us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.683408 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 18:35:37.684401 21548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.666801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:36794)
0810 18:35:37.667676 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.667709 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.667875 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.668282 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.668289 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.669121 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.669528 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.669541 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.670796 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.670800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.672334 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.672351 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.673175 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.673184 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.673395 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.674014 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.674055 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.676781 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.680540 (+ 3759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.680549 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.680559 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.681333 (+ 774us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.681704 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.681709 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.681712 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.681891 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.682616 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.682625 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.682826 (+ 201us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.683057 (+ 231us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.683389 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"spinlock_wait_cycles":36096,"thread_start_us":359,"threads_started":1}
I20260810 18:35:37.684463 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.661586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41550 (local address 127.13.139.60:33907)
0810 18:35:37.662383 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.662394 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.662434 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:35:37.664188 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.664239 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.664642 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.665041 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.666801 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.668659 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.670228 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.671211 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.671336 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.676575 (+ 5239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.676588 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.676603 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.676655 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.679694 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.680543 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.680551 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.680557 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.680802 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.681226 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.681232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.681237 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.681900 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.682152 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.682708 (+ 556us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.683190 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":600,"thread_start_us":387,"threads_started":1}
I20260810 18:35:37.686481 21544 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386937, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.60@KRBTEST.COM for oryx/127.13.139.61@KRBTEST.COM
I20260810 18:35:37.699508 21548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.687359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.0.0.1:38366)
0810 18:35:37.687571 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.687590 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.687694 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.687977 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.687980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.688272 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.688395 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.688402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.689457 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.689460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.690545 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.690557 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.691235 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.691239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.691380 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.692207 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.692224 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.694301 (+ 2077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.697281 (+ 2980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.697285 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.697287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.697663 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.698072 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.698075 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.698077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.698213 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.698742 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.698745 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.698857 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.698993 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.699201 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260810 18:35:37.699579 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.687285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38366 (local address 127.13.139.61:37515)
0810 18:35:37.687727 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.687732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.687747 (+ 15us) server_negotiation.cc:407] Connection header received
0810 18:35:37.687804 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.687808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.687866 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.687944 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.688542 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.689338 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.690682 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.691116 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.691214 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.694477 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.694481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.694485 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.694515 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.697157 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.697810 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.697815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.697819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.697958 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.698304 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.698307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.698309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.698644 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.698755 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.699081 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.699271 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286}
I20260810 18:35:37.700742 21544 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386937, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.60@KRBTEST.COM for oryx/127.13.139.60@KRBTEST.COM
I20260810 18:35:37.712435 21548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.701517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.0.0.1:41566)
0810 18:35:37.701688 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.701707 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.701813 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.702160 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.702164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.702526 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.702725 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.702734 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.703690 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.703697 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.704514 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.704525 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.705187 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.705192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.705427 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.705888 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.705903 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.707861 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.710425 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.710429 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.710431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.710773 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.711078 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.711081 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.711083 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.711224 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.711717 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.711720 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.711828 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.711969 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.712147 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":2}
I20260810 18:35:37.712553 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.701578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41566 (local address 127.13.139.60:33907)
0810 18:35:37.701707 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.701712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.701754 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:35:37.701920 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.701928 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.702048 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.702142 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.702846 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.703580 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.704645 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.705051 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.705180 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.708025 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.708030 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.708033 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.708070 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.710311 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.710867 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.710871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.710873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.710987 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.711310 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.711313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.711315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.711622 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.711729 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.712045 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.712270 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":47}
I20260810 18:35:37.717219 21544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Bootstrap starting.
I20260810 18:35:37.720502 21544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:37.721643 21544 log.cc:824] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:37.724272 21544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: No bootstrap required, opened a new log
I20260810 18:35:37.731189 21544 raft_consensus.cc:348] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } }
I20260810 18:35:37.731578 21544 raft_consensus.cc:374] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:37.731707 21544 raft_consensus.cc:729] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12e2a2154434cca8d7a7a758116c771, State: Initialized, Role: FOLLOWER
I20260810 18:35:37.732260 21544 consensus_queue.cc:260] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } }
I20260810 18:35:37.733074 21550 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } } }
I20260810 18:35:37.733368 21550 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:37.734076 21544 sys_catalog.cc:564] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:37.739809 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 20810
W20260810 18:35:37.744230 21562 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:35:37.744357 21562 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:35:37.748396 21365 master_runner.cc:428] Detected that this master e12e2a2154434cca8d7a7a758116c771 is joining an existing cluster
I20260810 18:35:37.748535 21365 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.139.60:33907
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.1@KRBTEST.COM
I20260810 18:35:37.778317 21564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.741047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38566 (local address 127.13.139.1:40703)
0810 18:35:37.744885 (+ 3838us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.744896 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.744928 (+ 32us) server_negotiation.cc:407] Connection header received
0810 18:35:37.745001 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.745009 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.745277 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.745453 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.747134 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.748759 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.750481 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.751224 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.751302 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.770202 (+ 18900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.770227 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.770246 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.770300 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.774470 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.775482 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.775494 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.775500 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.775668 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.776202 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.776208 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.776211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.776651 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.776927 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.777595 (+ 668us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.777878 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3634,"thread_start_us":3474,"threads_started":1}
I20260810 18:35:37.781133 20941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:37.785686 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.753458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38374 (local address 127.13.139.61:37515)
0810 18:35:37.753650 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.753658 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.767987 (+ 14329us) server_negotiation.cc:407] Connection header received
0810 18:35:37.768253 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.768260 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.768342 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.768416 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.769865 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.770961 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.773076 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.773735 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.773824 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.776260 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.776266 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.776271 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.776310 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.782221 (+ 5911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.783089 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.783097 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.783101 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.783277 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.783839 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.783844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.783848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.784245 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.784383 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.785051 (+ 668us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.785300 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:35:37.786824 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.754051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.0.0.1:38374)
0810 18:35:37.767865 (+ 13814us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.767885 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.768095 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.768637 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.768641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.769339 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.769699 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.769710 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.771167 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.771172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.772917 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.772932 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.774115 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.774121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.774287 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.774903 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.774935 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.776056 (+ 1121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.782427 (+ 6371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.782432 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.782435 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.782951 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.783477 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.783483 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.783488 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.783703 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.784480 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.784484 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.784714 (+ 230us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.785947 (+ 1233us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.786301 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13556,"thread_start_us":6892,"threads_started":1}
I20260810 18:35:37.788722 21571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.753280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:36810)
0810 18:35:37.760833 (+ 7553us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.760852 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.761303 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.761871 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.761879 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.762651 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.763033 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.763045 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.764558 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.764563 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.766270 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.766283 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.767341 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.767347 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.767578 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.779972 (+ 12394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.779995 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.781099 (+ 1104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.785429 (+ 4330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.785434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.785438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.785879 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.786559 (+ 680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.786564 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.786568 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.786764 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.787519 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.787524 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.787749 (+ 225us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.787895 (+ 146us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.788260 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7411,"thread_start_us":10523,"threads_started":1}
I20260810 18:35:37.789620 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.753058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36810 (local address 127.13.139.62:39197)
0810 18:35:37.753230 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.753235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.760938 (+ 7703us) server_negotiation.cc:407] Connection header received
0810 18:35:37.761484 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.761489 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.761575 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.761643 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.763204 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.764371 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.766441 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.767136 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.767276 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.781359 (+ 14083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.781368 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.781373 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.781415 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.785253 (+ 3838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.786251 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.786257 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.786261 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.786421 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.786932 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.786937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.786941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.787278 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.787450 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.789037 (+ 1587us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.789271 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 18:35:37.805509 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.768169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41582 (local address 127.13.139.60:33907)
0810 18:35:37.768318 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.768324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.788893 (+ 20569us) server_negotiation.cc:407] Connection header received
0810 18:35:37.789091 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.789096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.789163 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.789230 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.790218 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.791855 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.794336 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.795124 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.795237 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.797993 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.797999 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.798004 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.798036 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.802158 (+ 4122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.803033 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.803038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.803042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.803197 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.803673 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.803678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.803681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.804078 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.804205 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.804916 (+ 711us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.805134 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 18:35:37 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.62@KRBTEST.COM for oryx/127.13.139.60@KRBTEST.COM
I20260810 18:35:37.814309 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.768438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.0.0.1:41582)
0810 18:35:37.788806 (+ 20368us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.788827 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.788974 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.789401 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.789418 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.789949 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.790075 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.790083 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.792163 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.792171 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.794148 (+ 1977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.794167 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.795266 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.795271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.795527 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.796140 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.796168 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.797806 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.802383 (+ 4577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.802388 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.802392 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.802914 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.803341 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.803345 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.803349 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.803528 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.804372 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.804377 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.804576 (+ 199us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.813587 (+ 9011us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.813902 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20198,"thread_start_us":26116,"threads_started":1}
I20260810 18:35:37.822139 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.802252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.0.0.1:41584)
0810 18:35:37.802743 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.802767 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.802887 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.806221 (+ 3334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.806227 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.806714 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.806947 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.806960 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.808539 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.808545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.809967 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.809983 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.811110 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.811116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.811330 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.812003 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.812033 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.814972 (+ 2939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.819240 (+ 4268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.819246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.819250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.819772 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.820213 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.820219 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.820222 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.820372 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.821093 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.821098 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.821282 (+ 184us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.821437 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.821738 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329}
I20260810 18:35:37.823176 21547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.803156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41584 (local address 127.13.139.60:33907)
0810 18:35:37.805808 (+ 2652us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.805816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.805832 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:35:37.805932 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.805938 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.806045 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.807101 (+ 1056us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.807284 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.808379 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.810175 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.810897 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.813425 (+ 2528us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.815173 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.815182 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.815188 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.815224 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.819067 (+ 3843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.819935 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.819940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.819944 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.820077 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.820509 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.820514 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.820518 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.820882 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.821019 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.822579 (+ 1560us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.822804 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2552,"thread_start_us":10033,"threads_started":1}
I20260810 18:35:37.824681 20741 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.139.60:33907: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e12e2a2154434cca8d7a7a758116c771"
member_type: NON_VOTER
last_known_addr {
host: "127.13.139.60"
port: 33907
}
attrs {
promote: true
}
}
dest_uuid: "75497e66da0f43bfb17a45857c6a90e3"
cas_config_opid_index: 6
I20260810 18:35:37.825506 20741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } }
I20260810 18:35:37.827831 21424 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Refusing update from remote peer 75497e66da0f43bfb17a45857c6a90e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 18:35:37.828086 21516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:37.828490 21361 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 18:35:37.831575 21361 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER e12e2a2154434cca8d7a7a758116c771 (127.13.139.60) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:37.831990 21516 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 FOLLOWER]: Refusing update from remote peer 75497e66da0f43bfb17a45857c6a90e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 18:35:37.835351 21361 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.139.60:33907
I20260810 18:35:37.835517 21359 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:37.838514 21424 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER e12e2a2154434cca8d7a7a758116c771 (127.13.139.60) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:37.842952 21359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:37.843242 21359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:37.843734 21361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:37.844456 21454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:37.844740 21454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:37.845554 21361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:37.846144 21365 master.cc:537] Master@127.13.139.60:33907 shutting down...
I20260810 18:35:37.856371 21516 raft_consensus.cc:858] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } }
W20260810 18:35:37.856501 21516 raft_consensus.cc:1565] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } }
I20260810 18:35:37.866606 21516 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5d10378a66d64da690b1345a896b6c61 (127.13.139.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.883632 21582 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.884104 21582 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 18:35:37.884564 21550 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75497e66da0f43bfb17a45857c6a90e3. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.884783 21550 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 18:35:37.885120 21578 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: NON_VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: true } } }
I20260810 18:35:37.885401 21578 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 18:35:37.887472 21361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:37.887790 21361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:37.888651 21365 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
W20260810 18:35:37.889048 20722 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260810 18:35:37.889125 21365 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260810 18:35:37.889299 21365 tablet_replica.cc:330] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: stopping tablet replica
W20260810 18:35:37.890712 20722 consensus_peers.cc:487] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 -> Peer e12e2a2154434cca8d7a7a758116c771 (127.13.139.60:33907): Couldn't send request to peer e12e2a2154434cca8d7a7a758116c771. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 18:35:37.907859 21365 master.cc:552] Master@127.13.139.60:33907 shutdown complete.
I20260810 18:35:37.907963 21365 master_runner.cc:305] Clearing existing system tablet
I20260810 18:35:37.908372 21365 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:37.908499 21365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:37.911813 21365 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260810 18:35:37.913586 21585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:37.914129 21365 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:37.914413 21365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260810 18:35:37.914517 21365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
uuid: "e12e2a2154434cca8d7a7a758116c771"
format_stamp: "Formatted at 2026-08-10 18:35:37 on dist-test-slave-5k54"
server_key: "ce1439c61dd0439752a0f2ac8b5f3f73"
server_key_iv: "56a892a1ca6219cd4c40d4c372001e73"
server_key_version: "encryptionkey@0"
I20260810 18:35:37.919260 21365 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:37.926543 21365 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 18:35:37.926723 21365 log.cc:1196] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 18:35:37.927263 21365 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Deleting consensus metadata
I20260810 18:35:37.927579 21365 master_runner.cc:315] Copying system tablet from 127.13.139.62:39197
I20260810 18:35:37.930338 21365 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: tablet copy: Beginning tablet copy session from remote peer at address 127.13.139.62:39197
I20260810 18:35:37.934870 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 20810
I20260810 18:35:37.951308 21331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.931305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36820 (local address 127.13.139.62:39197)
0810 18:35:37.931585 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:37.931592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:37.934359 (+ 2767us) server_negotiation.cc:407] Connection header received
0810 18:35:37.934634 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:37.934639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:37.934732 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:37.934853 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:37.936264 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.937626 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.939920 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.940694 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.940901 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.943995 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:37.944004 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:37.944012 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:37.944052 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:37.947886 (+ 3834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.948837 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.948843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.948847 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.949009 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:37.949503 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:37.949509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:37.949512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:37.949944 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:37.950104 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:37.950692 (+ 588us) server_negotiation.cc:299] Negotiation successful
0810 18:35:37.950946 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260810 18:35:37.951524 21591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:37.931241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:36820)
0810 18:35:37.934222 (+ 2981us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:37.934258 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:37.934450 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:37.934912 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:37.934922 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:37.935590 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:37.936052 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.936070 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.937852 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.937859 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.939734 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:37.939753 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:37.941188 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:37.941196 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:37.941447 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:37.942260 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:37.942292 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:37.943742 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:37.948045 (+ 4303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.948053 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.948060 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.948697 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.949133 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:37.949141 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:37.949148 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:37.949372 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:37.950088 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:37.950096 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:37.950387 (+ 291us) client_negotiation.cc:769] Sending connection context
0810 18:35:37.950548 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 18:35:37.950948 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2804,"thread_start_us":2637,"threads_started":1}
I20260810 18:35:37.952050 20763 tablet_copy_service.cc:140] P 75497e66da0f43bfb17a45857c6a90e3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e12e2a2154434cca8d7a7a758116c771 ({username='oryx', principal='oryx/127.13.139.60@KRBTEST.COM'} at 127.0.0.1:36820)
I20260810 18:35:37.952230 20763 tablet_copy_service.cc:161] P 75497e66da0f43bfb17a45857c6a90e3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e12e2a2154434cca8d7a7a758116c771 at {username='oryx', principal='oryx/127.13.139.60@KRBTEST.COM'} at 127.0.0.1:36820: session id = e12e2a2154434cca8d7a7a758116c771-00000000000000000000000000000000
I20260810 18:35:37.956084 20763 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 18:35:37.958009 21365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 18:35:37.959826 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:40703
--local_ip_for_outbound_sockets=127.13.139.1
--tserver_master_addrs=127.13.139.62:39197
--webserver_port=45175
--webserver_interface=127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab
--principal=oryx/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:35:37.965031 21365 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: tablet copy: Starting download of 0 data blocks...
I20260810 18:35:37.965339 21365 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: tablet copy: Starting download of 1 WAL segments...
I20260810 18:35:37.967835 21365 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 18:35:37.972272 20763 tablet_copy_service.cc:342] P 75497e66da0f43bfb17a45857c6a90e3: Request end of tablet copy session e12e2a2154434cca8d7a7a758116c771-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.139.60@KRBTEST.COM'} at 127.0.0.1:36820
I20260810 18:35:37.972446 20763 tablet_copy_service.cc:433] P 75497e66da0f43bfb17a45857c6a90e3: ending tablet copy session e12e2a2154434cca8d7a7a758116c771-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e12e2a2154434cca8d7a7a758116c771
I20260810 18:35:37.985476 21365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:37.989027 21593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:37.990458 21594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:37.997138 21597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:38.008910 21365 server_base.cc:1034] running on GCE node
I20260810 18:35:38.009325 21365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:38.010062 21365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:38.011292 21365 hybrid_clock.cc:648] HybridClock initialized: now 1786386938011238 us; error 32 us; skew 500 ppm
I20260810 18:35:38.011615 21365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:38 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386938, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:38.013916 21365 init.cc:377] Logged in from keytab as oryx/127.13.139.60@KRBTEST.COM (short username oryx)
I20260810 18:35:38.020885 21365 webserver.cc:460] Webserver started at http://127.13.139.60:45121/ using document root <none> and password file <none>
I20260810 18:35:38.021231 21365 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:38.021355 21365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:38.024842 21365 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260810 18:35:38.026844 21606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:38.027463 21365 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260810 18:35:38.027623 21365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
uuid: "e12e2a2154434cca8d7a7a758116c771"
format_stamp: "Formatted at 2026-08-10 18:35:37 on dist-test-slave-5k54"
server_key: "ce1439c61dd0439752a0f2ac8b5f3f73"
server_key_iv: "56a892a1ca6219cd4c40d4c372001e73"
server_key_version: "encryptionkey@0"
I20260810 18:35:38.027854 21365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:38.077266 21365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:38.081916 21365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:38.115610 21365 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.60:33907
I20260810 18:35:38.115682 21660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.60:33907 every 8 connection(s)
I20260810 18:35:38.116714 21365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
I20260810 18:35:38.122004 21661 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:35:38.126399 21661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Bootstrap starting.
I20260810 18:35:38.144735 21661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:35:38.145323 21661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Bootstrap complete.
I20260810 18:35:38.146485 21661 raft_consensus.cc:348] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } }
I20260810 18:35:38.146819 21661 raft_consensus.cc:729] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e12e2a2154434cca8d7a7a758116c771, State: Initialized, Role: LEARNER
I20260810 18:35:38.147109 21661 consensus_queue.cc:260] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } }
I20260810 18:35:38.151937 21664 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:38.152513 21664 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: LEARNER
I20260810 18:35:38.152352 21661 sys_catalog.cc:564] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:38.160764 21677 catalog_manager.cc:1259] Loaded cluster ID: 3dae4da720d4462392e7b6458fbd6ab0
I20260810 18:35:38.160938 21677 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: loading cluster ID for follower catalog manager: success
I20260810 18:35:38.164587 21677 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: acquiring CA information for follower catalog manager: success
I20260810 18:35:38.167379 21677 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 18:35:38.361671 21592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:38.362104 21592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:38.362278 21592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:38.371927 21592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:38.372036 21592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:38.372151 21592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:38.382318 21592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab
--principal=oryx/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:40703
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=45175
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:38.383839 21592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:38.385226 21592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:38.398854 21682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:38.399000 21684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:38.399490 21686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:38.400219 21592 server_base.cc:1034] running on GCE node
I20260810 18:35:38.400897 21592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:38.402084 21592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:38.403306 21592 hybrid_clock.cc:648] HybridClock initialized: now 1786386938403224 us; error 68 us; skew 500 ppm
I20260810 18:35:38.403656 21592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:38 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386938, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:38.407048 21592 init.cc:377] Logged in from keytab as oryx/127.13.139.1@KRBTEST.COM (short username oryx)
I20260810 18:35:38.408548 21592 webserver.cc:460] Webserver started at http://127.13.139.1:45175/ using document root <none> and password file <none>
I20260810 18:35:38.409246 21592 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:38.409415 21592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:38.415019 21592 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 18:35:38.417760 21694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:38.419114 21592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:35:38.419337 21592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "26022dbf3568467c983382d03b554443"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "89f3b7a62813a21c42726c75dcdc8bfa"
server_key_iv: "a75c5f48a3feff1ab97791c30e69042f"
server_key_version: "encryptionkey@0"
I20260810 18:35:38.420655 21592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:38.444077 21592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:38.447391 21360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:38.447757 21360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:38.449641 21592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:38.450098 21592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:38.463644 21592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:38.465487 21592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:38.465590 21592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:38.465744 21592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:38.465821 21592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:38.469025 21703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.448154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41588 (local address 127.13.139.60:33907)
0810 18:35:38.462495 (+ 14341us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:38.462505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:38.463104 (+ 599us) server_negotiation.cc:407] Connection header received
0810 18:35:38.463331 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:38.463339 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:38.463491 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:38.463637 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:38.464211 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.465147 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.467126 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.468021 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.468176 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.468428 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:38.468574 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 18:35:38.468705 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14133,"thread_start_us":13949,"threads_started":1}
I20260810 18:35:38.469044 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.447994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.0.0.1:41588)
0810 18:35:38.462983 (+ 14989us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:38.462999 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:38.463185 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:38.463700 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:38.463710 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:38.463742 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:38.464042 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.464058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.465310 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.465316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.466955 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.466975 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.468213 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.468219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.468415 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.468453 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 18:35:38.468552 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 18:35:38.468699 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14858,"thread_start_us":14741,"threads_started":1}
I20260810 18:35:38.470034 21636 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260810 18:35:38.470523 21664 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75497e66da0f43bfb17a45857c6a90e3. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: NON_VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: true } } }
I20260810 18:35:38.470927 21664 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: LEARNER
I20260810 18:35:38.471287 21360 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: attempting to promote NON_VOTER e12e2a2154434cca8d7a7a758116c771 to VOTER
I20260810 18:35:38.472174 21360 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } }
I20260810 18:35:38.474407 21636 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 LEARNER]: Refusing update from remote peer 75497e66da0f43bfb17a45857c6a90e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 18:35:38.474408 21424 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Refusing update from remote peer 75497e66da0f43bfb17a45857c6a90e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260810 18:35:38.475016 21699 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 18:35:38.475385 21700 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 18:35:38.478298 21699 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e12e2a2154434cca8d7a7a758116c771 (127.13.139.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.479542 21636 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e12e2a2154434cca8d7a7a758116c771 (127.13.139.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.480273 21424 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e12e2a2154434cca8d7a7a758116c771 (127.13.139.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.482748 21699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.483006 21699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:38.483250 21360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.483469 21360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:38.484129 21360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.485011 21360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:38.485196 21664 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.485533 21664 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:38.493824 21725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75497e66da0f43bfb17a45857c6a90e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:38.494190 21725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:38.523921 21592 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:40703
I20260810 18:35:38.524071 21822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:40703 every 8 connection(s)
I20260810 18:35:38.525490 21592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:38.529767 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 21592
I20260810 18:35:38.530184 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 20953
Aug 10 18:35:38 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386938, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.61@KRBTEST.COM
Aug 10 18:35:38 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386938, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
Aug 10 18:35:38 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386938, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.60@KRBTEST.COM
Aug 10 18:35:38 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.2@KRBTEST.COM
I20260810 18:35:38.568619 21703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.544596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:55801 (local address 127.13.139.60:33907)
0810 18:35:38.544788 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:38.544794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:38.548326 (+ 3532us) server_negotiation.cc:407] Connection header received
0810 18:35:38.548599 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:38.548605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:38.548689 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:38.548758 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:38.550613 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.551735 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.554313 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.554964 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.555075 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.561327 (+ 6252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:38.561336 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:38.561343 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:38.561388 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:38.565150 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.565889 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.565895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.565898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.566087 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.566531 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.566536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.566539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.566891 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:38.567019 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:38.568011 (+ 992us) server_negotiation.cc:299] Negotiation successful
0810 18:35:38.568264 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:35:38.569998 21835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.544821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.13.139.1:55801)
0810 18:35:38.548212 (+ 3391us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:38.548233 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:38.548443 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:38.548992 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:38.549006 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:38.550139 (+ 1133us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:38.550430 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.550452 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.551972 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.551977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.554153 (+ 2176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.554171 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.555408 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.555415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.555627 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.557261 (+ 1634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:38.557284 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:38.561068 (+ 3784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:38.565331 (+ 4263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:38.565336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:38.565340 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:38.565760 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:38.566233 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:38.566238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:38.566241 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:38.566391 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:38.567417 (+ 1026us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:38.567422 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:38.567594 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 18:35:38.567904 (+ 310us) client_negotiation.cc:240] Negotiation successful
0810 18:35:38.569005 (+ 1101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3269,"mutex_wait_us":682,"spinlock_wait_cycles":7424,"thread_start_us":3094,"threads_started":1}
I20260810 18:35:38.570636 21829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.528533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:57593 (local address 127.13.139.61:37515)
0810 18:35:38.541023 (+ 12490us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:38.541032 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:38.545053 (+ 4021us) server_negotiation.cc:407] Connection header received
0810 18:35:38.545154 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:38.545163 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:38.545276 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:38.545403 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:38.549358 (+ 3955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.550598 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.553396 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.554073 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.554165 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.559552 (+ 5387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:38.559562 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:38.559569 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:38.559618 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:38.564661 (+ 5043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.565818 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.565823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.565826 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.565977 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.566538 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.566543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.566546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.566890 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:38.567053 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:38.570000 (+ 2947us) server_negotiation.cc:299] Negotiation successful
0810 18:35:38.570237 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12272,"thread_start_us":12507,"threads_started":1}
I20260810 18:35:38.571005 21834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.532062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33118 (local address 127.13.139.2:45629)
0810 18:35:38.543986 (+ 11924us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:38.543998 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:38.548580 (+ 4582us) server_negotiation.cc:407] Connection header received
0810 18:35:38.548657 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:38.548666 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:38.548947 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:38.549171 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:38.550974 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.552718 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.554831 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.555883 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.556005 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.562608 (+ 6603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:38.562624 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:38.562663 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:38.562710 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:38.566768 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.567783 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.567791 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.567795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.567977 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.568412 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.568417 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.568421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.568806 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:38.569106 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:38.570286 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0810 18:35:38.570534 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11720,"thread_start_us":11550,"threads_started":1}
I20260810 18:35:38.571100 21828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.528466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:38305 (local address 127.13.139.62:39197)
0810 18:35:38.547998 (+ 19532us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:38.548005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:38.548036 (+ 31us) server_negotiation.cc:407] Connection header received
0810 18:35:38.548101 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:38.548106 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:38.548189 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:38.548313 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:38.550646 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.551895 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.554150 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.554782 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.554900 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.560240 (+ 5340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:38.560247 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:38.560253 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:38.560301 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:38.565216 (+ 4915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.567088 (+ 1872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.567094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.567097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.567230 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:38.568167 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:38.568174 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:38.568177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:38.568533 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:38.568687 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:38.570506 (+ 1819us) server_negotiation.cc:299] Negotiation successful
0810 18:35:38.570681 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19367,"thread_start_us":19177,"threads_started":1}
I20260810 18:35:38.570372 21830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.529148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.1:38305)
0810 18:35:38.539233 (+ 10085us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:38.539302 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:38.542607 (+ 3305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:38.548656 (+ 6049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:38.548661 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:38.549235 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:38.549518 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.549530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.552077 (+ 2547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.552086 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.553966 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.553982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.555519 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.555535 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.555734 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.557281 (+ 1547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:38.557310 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:38.560020 (+ 2710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:38.566138 (+ 6118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:38.566144 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:38.566149 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:38.566733 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:38.567364 (+ 631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:38.567370 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:38.567373 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:38.567587 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:38.569230 (+ 1643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:38.569235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:38.569433 (+ 198us) client_negotiation.cc:769] Sending connection context
0810 18:35:38.569568 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 18:35:38.569850 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9667,"mutex_wait_us":82,"spinlock_wait_cycles":4224,"thread_start_us":13806,"threads_started":1}
I20260810 18:35:38.570989 21832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:38.531789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.13.139.1:57593)
0810 18:35:38.544645 (+ 12856us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:38.544678 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:38.544905 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:38.546123 (+ 1218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:38.546141 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:38.548108 (+ 1967us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:38.549129 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.549156 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.550816 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.550823 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.553220 (+ 2397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:38.553235 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:38.554520 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:38.554528 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:38.554793 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:38.555690 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:38.555726 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:38.559231 (+ 3505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:38.564865 (+ 5634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:38.564878 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:38.564899 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:38.565659 (+ 760us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:38.566104 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:38.566109 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:38.566114 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:38.566395 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:38.567039 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:38.567050 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:38.567561 (+ 511us) client_negotiation.cc:769] Sending connection context
0810 18:35:38.567903 (+ 342us) client_negotiation.cc:240] Negotiation successful
0810 18:35:38.568487 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12683,"mutex_wait_us":37,"spinlock_wait_cycles":3072,"thread_start_us":12394,"threads_started":1}
I20260810 18:35:38.572911 21089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:38.572983 21826 heartbeater.cc:347] Connected to a master server at 127.13.139.61:37515
I20260810 18:35:38.573071 21824 heartbeater.cc:347] Connected to a master server at 127.13.139.60:33907
I20260810 18:35:38.573189 21825 heartbeater.cc:347] Connected to a master server at 127.13.139.62:39197
I20260810 18:35:38.573348 21826 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:38.573357 21825 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:38.573357 21824 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:38.574523 21826 heartbeater.cc:511] Master 127.13.139.61:37515 requested a full tablet report, sending...
I20260810 18:35:38.574580 21824 heartbeater.cc:511] Master 127.13.139.60:33907 requested a full tablet report, sending...
I20260810 18:35:38.574620 21825 heartbeater.cc:511] Master 127.13.139.62:39197 requested a full tablet report, sending...
I20260810 18:35:38.576948 20741 ts_manager.cc:194] Re-registered known tserver with Master: 26022dbf3568467c983382d03b554443 (127.13.139.1:40703)
I20260810 18:35:38.577282 21626 ts_manager.cc:194] Registered new tserver with Master: 26022dbf3568467c983382d03b554443 (127.13.139.1:40703)
I20260810 18:35:38.578205 20741 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:38305
I20260810 18:35:38.579646 21412 ts_manager.cc:194] Registered new tserver with Master: 26022dbf3568467c983382d03b554443 (127.13.139.1:40703)
I20260810 18:35:38.666452 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 20953
I20260810 18:35:38.686481 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:45629
--local_ip_for_outbound_sockets=127.13.139.2
--tserver_master_addrs=127.13.139.62:39197
--webserver_port=35255
--webserver_interface=127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab
--principal=oryx/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:39.025297 21837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:39.025673 21837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:39.025844 21837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:39.033260 21837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:39.033413 21837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:39.033586 21837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:39.043579 21837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab
--principal=oryx/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:45629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=35255
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:39.044960 21837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:39.046305 21837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:39.059810 21844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:39.059774 21846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:39.059743 21848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:39.060616 21837 server_base.cc:1034] running on GCE node
I20260810 18:35:39.061242 21837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:39.062112 21837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:39.063323 21837 hybrid_clock.cc:648] HybridClock initialized: now 1786386939063274 us; error 42 us; skew 500 ppm
I20260810 18:35:39.063679 21837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:39.066845 21837 init.cc:377] Logged in from keytab as oryx/127.13.139.2@KRBTEST.COM (short username oryx)
I20260810 18:35:39.068356 21837 webserver.cc:460] Webserver started at http://127.13.139.2:35255/ using document root <none> and password file <none>
I20260810 18:35:39.069000 21837 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:39.069114 21837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:39.074676 21837 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260810 18:35:39.077450 21856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:39.078794 21837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:39.079012 21837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "c76195126ba54f8387f1c92b6084e738"
format_stamp: "Formatted at 2026-08-10 18:35:35 on dist-test-slave-5k54"
server_key: "a35c8d8d676ee65bd66b32d357911d6d"
server_key_iv: "7335b2776d39bc72d247adce0424f04e"
server_key_version: "encryptionkey@0"
I20260810 18:35:39.080176 21837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:39.102381 21837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:39.106995 21837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:39.107301 21837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:39.108439 21837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:39.109897 21837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:39.110019 21837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:39.110169 21837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:39.110267 21837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:39.145639 21837 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:45629
I20260810 18:35:39.145727 21980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:45629 every 8 connection(s)
I20260810 18:35:39.147164 21837 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:39.151768 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 21837
I20260810 18:35:39.152149 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 21102
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.3@KRBTEST.COM
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.61@KRBTEST.COM
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.60@KRBTEST.COM
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:39.188084 21986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.150264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:56437 (local address 127.13.139.61:37515)
0810 18:35:39.165195 (+ 14931us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.165204 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.166464 (+ 1260us) server_negotiation.cc:407] Connection header received
0810 18:35:39.166536 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.166541 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.166616 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.166721 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.169739 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.171057 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.173673 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.174305 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.174436 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.179981 (+ 5545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.179989 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.179997 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.180042 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.183889 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.185053 (+ 1164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.185058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.185061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.185215 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.185811 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.185816 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.185819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.186248 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.186390 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.187484 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.187711 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14761,"thread_start_us":14616,"threads_started":1}
I20260810 18:35:39.188126 21987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.150652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:55685 (local address 127.13.139.60:33907)
0810 18:35:39.165653 (+ 15001us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.165662 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.165688 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:35:39.166494 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.166499 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.166601 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.166709 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.172159 (+ 5450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.173284 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.175171 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.175952 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.176062 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.180560 (+ 4498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.180568 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.180574 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.180623 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.184417 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.185360 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.185367 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.185371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.185540 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.186066 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.186074 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.186076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.186428 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.186577 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.187497 (+ 920us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.187733 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14830,"thread_start_us":14702,"threads_started":1}
I20260810 18:35:39.189309 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.153778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54758 (local address 127.13.139.3:34279)
0810 18:35:39.160094 (+ 6316us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.160107 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.160903 (+ 796us) server_negotiation.cc:407] Connection header received
0810 18:35:39.161009 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.161021 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.161304 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.161487 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.164231 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.166038 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.168568 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.169706 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.169859 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.177746 (+ 7887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.177766 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.177785 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.177842 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.183679 (+ 5837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.185038 (+ 1359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.185047 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.185051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.185223 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.186014 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.186022 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.186028 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.186454 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.186746 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.188623 (+ 1877us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.188886 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6057,"thread_start_us":5872,"threads_started":1}
I20260810 18:35:39.189925 21989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.150788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.13.139.2:55685)
0810 18:35:39.160787 (+ 9999us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.160851 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.166051 (+ 5200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.167150 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.167162 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.171652 (+ 4490us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:39.171964 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.171976 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.173463 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.173468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.175002 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.175015 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.176530 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.176539 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.176749 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.177846 (+ 1097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:39.177862 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:39.180303 (+ 2441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:39.184588 (+ 4285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.184593 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.184597 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.185222 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.185692 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.185696 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.185702 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.185915 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.186670 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:39.186675 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:39.186989 (+ 314us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.188382 (+ 1393us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.188706 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9605,"spinlock_wait_cycles":1792,"thread_start_us":15004,"threads_started":1}
I20260810 18:35:39.190867 21239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:39.191550 21982 heartbeater.cc:347] Connected to a master server at 127.13.139.60:33907
I20260810 18:35:39.191865 21982 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:39.192899 21982 heartbeater.cc:511] Master 127.13.139.60:33907 requested a full tablet report, sending...
I20260810 18:35:39.193703 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.150788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.13.139.2:56437)
0810 18:35:39.166208 (+ 15420us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.166226 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.166353 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.167155 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.167166 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.168389 (+ 1223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:39.169479 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.169509 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.171230 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.171235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.173490 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.173505 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.174718 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.174724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.174997 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.175857 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:39.175888 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:39.179694 (+ 3806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:39.184052 (+ 4358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.184065 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.184081 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.184915 (+ 834us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.185356 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.185361 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.185364 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.185648 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.186483 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:39.186491 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:39.187007 (+ 516us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.187349 (+ 342us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.187974 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15263,"mutex_wait_us":36,"spinlock_wait_cycles":139136,"thread_start_us":12481,"threads_started":1}
I20260810 18:35:39.194936 21626 ts_manager.cc:194] Registered new tserver with Master: c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629)
I20260810 18:35:39.194994 21984 heartbeater.cc:347] Connected to a master server at 127.13.139.61:37515
I20260810 18:35:39.195158 21984 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:39.195678 21984 heartbeater.cc:511] Master 127.13.139.61:37515 requested a full tablet report, sending...
I20260810 18:35:39.196830 21412 ts_manager.cc:194] Registered new tserver with Master: c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629)
I20260810 18:35:39.197685 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.167607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.2:34849)
0810 18:35:39.177453 (+ 9846us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.177480 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.177641 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.179005 (+ 1364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.179011 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.179709 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:39.180147 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.180163 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.181734 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.181739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.183362 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.183380 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.184834 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.184841 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.185061 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.185604 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:39.185638 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:39.188949 (+ 3311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:39.194319 (+ 5370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.194323 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.194326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.194814 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.195624 (+ 810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.195629 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.195634 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.195969 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.196676 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:39.196684 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:39.196850 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.197020 (+ 170us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.197419 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9702,"spinlock_wait_cycles":1920,"thread_start_us":9542,"threads_started":1}
I20260810 18:35:39.197775 21992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.166584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:34849 (local address 127.13.139.62:39197)
0810 18:35:39.170820 (+ 4236us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.170825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.178628 (+ 7803us) server_negotiation.cc:407] Connection header received
0810 18:35:39.178711 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.178719 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.178823 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.178952 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.180405 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.181566 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.183588 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.184285 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.184380 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.189270 (+ 4890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.189276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.189284 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.189329 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.193399 (+ 4070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.195022 (+ 1623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.195028 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.195032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.195193 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.196198 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.196204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.196207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.196542 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.196689 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.197171 (+ 482us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.197413 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4109,"thread_start_us":4006,"threads_started":1}
I20260810 18:35:39.198552 21983 heartbeater.cc:347] Connected to a master server at 127.13.139.62:39197
I20260810 18:35:39.198698 21983 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:39.199115 21983 heartbeater.cc:511] Master 127.13.139.62:39197 requested a full tablet report, sending...
I20260810 18:35:39.201228 20741 ts_manager.cc:194] Re-registered known tserver with Master: c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629)
I20260810 18:35:39.202235 20741 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:34849
I20260810 18:35:39.280038 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 21102
I20260810 18:35:39.301255 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:34279
--local_ip_for_outbound_sockets=127.13.139.3
--tserver_master_addrs=127.13.139.62:39197
--webserver_port=39139
--webserver_interface=127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab
--principal=oryx/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:34219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:35:39.580665 21825 heartbeater.cc:503] Master 127.13.139.62:39197 was elected leader, sending a full tablet report...
W20260810 18:35:39.642951 21995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:39.643265 21995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:39.643455 21995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:39.650779 21995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:39.650943 21995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:39.651124 21995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:39.662000 21995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:34219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab
--principal=oryx/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:34279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=39139
--tserver_master_addrs=127.13.139.62:39197,127.13.139.61:37515,127.13.139.60:33907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:39.663614 21995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:39.665067 21995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:39.679313 22002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:39.679404 22004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:39.679282 22001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:39.680402 21995 server_base.cc:1034] running on GCE node
I20260810 18:35:39.681113 21995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:39.682096 21995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:39.683339 21995 hybrid_clock.cc:648] HybridClock initialized: now 1786386939683261 us; error 56 us; skew 500 ppm
I20260810 18:35:39.683698 21995 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:39.687096 21995 init.cc:377] Logged in from keytab as oryx/127.13.139.3@KRBTEST.COM (short username oryx)
I20260810 18:35:39.688622 21995 webserver.cc:460] Webserver started at http://127.13.139.3:39139/ using document root <none> and password file <none>
I20260810 18:35:39.689322 21995 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:39.689472 21995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:39.694882 21995 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260810 18:35:39.697750 22011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:39.699543 21995 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:35:39.699718 21995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "00d6393d56f04094a68320314fca78a9"
format_stamp: "Formatted at 2026-08-10 18:35:36 on dist-test-slave-5k54"
server_key: "f423d8f271e1f7bcf123f9afaa0459ae"
server_key_iv: "846b96e4e8c59902bf3bd94606fc9255"
server_key_version: "encryptionkey@0"
I20260810 18:35:39.700678 21995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:39.713522 21995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:39.717823 21995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:39.718108 21995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:39.719080 21995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:39.720621 21995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:39.720739 21995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:39.720862 21995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:39.720954 21995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:39.755367 21995 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:34279
I20260810 18:35:39.755472 22131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:34279 every 8 connection(s)
I20260810 18:35:39.757012 21995 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:39.765197 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 21995
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.61@KRBTEST.COM
I20260810 18:35:39.806859 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.760951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:46673 (local address 127.13.139.61:37515)
0810 18:35:39.772153 (+ 11202us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.772162 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.777467 (+ 5305us) server_negotiation.cc:407] Connection header received
0810 18:35:39.778987 (+ 1520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.778993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.779077 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.779163 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.782591 (+ 3428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.783692 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.786812 (+ 3120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.787563 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.787669 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.795005 (+ 7336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.795011 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.795016 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.795060 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.799587 (+ 4527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.800839 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.800847 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.800854 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.801053 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.801670 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.801678 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.801684 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.802110 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.802247 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.806121 (+ 3874us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.806387 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11031,"thread_start_us":10929,"threads_started":1}
I20260810 18:35:39.809455 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.760685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.13.139.3:46673)
0810 18:35:39.777292 (+ 16607us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.777320 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.778017 (+ 697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.779415 (+ 1398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.779440 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.780178 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:39.782397 (+ 2219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.782410 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.783865 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.783870 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.786639 (+ 2769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.786653 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.787962 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.787968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.788160 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.789185 (+ 1025us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:39.789212 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:39.794776 (+ 5564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:39.799816 (+ 5040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.799829 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.799853 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.800655 (+ 802us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.801225 (+ 570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.801232 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.801238 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.801517 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.804251 (+ 2734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:39.804262 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:39.804746 (+ 484us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.807268 (+ 2522us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.807933 (+ 665us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16404,"mutex_wait_us":1479,"thread_start_us":17516,"threads_started":1}
I20260810 18:35:39.810123 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.759992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:52259 (local address 127.13.139.62:39197)
0810 18:35:39.760448 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.760455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.776049 (+ 15594us) server_negotiation.cc:407] Connection header received
0810 18:35:39.778331 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.778337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.778430 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.778564 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.781337 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.782123 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.785114 (+ 2991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.785800 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.785988 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.792226 (+ 6238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.792232 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.792235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.792267 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.795820 (+ 3553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.803516 (+ 7696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.803522 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.803526 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.803691 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.804547 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.804552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.804555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.805080 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.805311 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.809243 (+ 3932us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.809488 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":1083,"threads_started":1}
I20260810 18:35:39.811316 22134 heartbeater.cc:347] Connected to a master server at 127.13.139.61:37515
I20260810 18:35:39.811712 22134 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:39.812819 22134 heartbeater.cc:511] Master 127.13.139.61:37515 requested a full tablet report, sending...
I20260810 18:35:39.814868 21412 ts_manager.cc:194] Registered new tserver with Master: 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279)
Aug 10 18:35:39 dist-test-slave-5k54 krb5kdc[20693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386939, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.60@KRBTEST.COM
I20260810 18:35:39.816392 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.760684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:52259)
0810 18:35:39.775861 (+ 15177us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.775902 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.778017 (+ 2115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.778919 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.778934 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.780012 (+ 1078us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:39.781169 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.781196 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.782466 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.782474 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.784959 (+ 2485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.784974 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.786234 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.786241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.786558 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.787376 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:39.787407 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:39.791996 (+ 4589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:39.802147 (+ 10151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.802153 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.802159 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.803087 (+ 928us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.803855 (+ 768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.803859 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.803862 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.804367 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.805413 (+ 1046us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:39.805418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:39.805574 (+ 156us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.810573 (+ 4999us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.810892 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14880,"mutex_wait_us":90,"spinlock_wait_cycles":157696,"thread_start_us":16714,"threads_started":1}
I20260810 18:35:39.817423 22133 heartbeater.cc:347] Connected to a master server at 127.13.139.62:39197
I20260810 18:35:39.817570 22133 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:39.818110 22133 heartbeater.cc:511] Master 127.13.139.62:39197 requested a full tablet report, sending...
I20260810 18:35:39.819149 20741 ts_manager.cc:194] Re-registered known tserver with Master: 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279)
I20260810 18:35:39.820436 20741 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:52259
I20260810 18:35:39.826146 22144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.778892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.13.139.3:33821)
0810 18:35:39.788816 (+ 9924us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.788840 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.788964 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.790957 (+ 1993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.790962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.791553 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:39.791976 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.791987 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.802316 (+ 10329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.802321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.804049 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.804062 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.811671 (+ 7609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.811680 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.811909 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.812576 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:39.812604 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:39.818522 (+ 5918us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:39.822913 (+ 4391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.822918 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.822922 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.823547 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.824029 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:39.824034 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:39.824039 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:39.824220 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:39.825072 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:39.825077 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:39.825262 (+ 185us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.825423 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.825755 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9801,"thread_start_us":9665,"threads_started":1}
I20260810 18:35:39.826267 22145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.779015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:33821 (local address 127.13.139.60:33907)
0810 18:35:39.786353 (+ 7338us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.786360 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.790481 (+ 4121us) server_negotiation.cc:407] Connection header received
0810 18:35:39.790565 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.790570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.790651 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.790765 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.792858 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.793989 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.810503 (+ 16514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.811172 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.811293 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.818749 (+ 7456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.818757 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.818765 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.818810 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.822736 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.823697 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.823704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.823707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.823884 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.824482 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.824490 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.824494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.824924 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.825086 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.825590 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.825855 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":2137,"thread_start_us":2039,"threads_started":1}
I20260810 18:35:39.827147 22132 heartbeater.cc:347] Connected to a master server at 127.13.139.60:33907
I20260810 18:35:39.827308 22132 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:39.827791 22132 heartbeater.cc:511] Master 127.13.139.60:33907 requested a full tablet report, sending...
I20260810 18:35:39.829404 21626 ts_manager.cc:194] Registered new tserver with Master: 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279)
I20260810 18:35:39.837857 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.789338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38378 (local address 127.13.139.61:37515)
0810 18:35:39.807119 (+ 17781us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.807125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.815148 (+ 8023us) server_negotiation.cc:407] Connection header received
0810 18:35:39.815687 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.815697 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.815836 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.815973 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.821098 (+ 5125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.822243 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.826022 (+ 3779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.826681 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.826783 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.831310 (+ 4527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.831315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.831318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.831351 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.834779 (+ 3428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.835712 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.835720 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.835723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.835890 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.836331 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.836338 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.836341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.836635 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.836889 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.837377 (+ 488us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.837585 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17691,"thread_start_us":31155,"threads_started":1}
I20260810 18:35:39.839177 22151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.796097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41596 (local address 127.13.139.60:33907)
0810 18:35:39.814686 (+ 18589us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.814692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.821231 (+ 6539us) server_negotiation.cc:407] Connection header received
0810 18:35:39.821299 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.821303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.821403 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.821514 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.824769 (+ 3255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.826228 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.829067 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.830078 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.830235 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.833321 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.833326 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.833329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.833360 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.836210 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.837099 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.837103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.837105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.837224 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.837613 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.837618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.837621 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.837992 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.838333 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.838543 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.838760 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":18460,"thread_start_us":19893,"threads_started":1}
I20260810 18:35:39.840574 22147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.783706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36836 (local address 127.13.139.62:39197)
0810 18:35:39.805524 (+ 21818us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.805531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.805549 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:35:39.805595 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.805599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.805681 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.805785 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:39.816187 (+ 10402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.817739 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.826507 (+ 8768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.827181 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.827334 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.831997 (+ 4663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:39.832005 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:39.832012 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:39.832067 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:39.835962 (+ 3895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.837095 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.837101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.837105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.837274 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:39.837921 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:39.837927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:39.837931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:39.838295 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:39.838534 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.839918 (+ 1384us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.840173 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21691,"thread_start_us":21566,"threads_started":1}
I20260810 18:35:39.844223 20741 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:39.851270 20741 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:39.886010 22165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.869160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:34279 (local address 127.0.0.1:54768)
0810 18:35:39.869886 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.869919 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.870024 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.875566 (+ 5542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.875574 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.875614 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:39.876085 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.876121 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.879985 (+ 3864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.879994 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.882969 (+ 2975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.882981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.885153 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.885160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.885359 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.885397 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.885523 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.885655 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":461,"threads_started":1}
I20260810 18:35:39.886085 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.869615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54768 (local address 127.13.139.3:34279)
0810 18:35:39.870386 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.870396 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.870431 (+ 35us) server_negotiation.cc:407] Connection header received
0810 18:35:39.870554 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.870563 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.871586 (+ 1023us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.871811 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:39.876394 (+ 4583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.879761 (+ 3367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.883130 (+ 3369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.884956 (+ 1826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.885095 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.885341 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.885570 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.885743 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":1931,"threads_started":1}
I20260810 18:35:39.890769 22062 tablet_service.cc:1467] Processing CreateTablet for tablet 4c372d6a1df943aaaf589d30d2332de2 (DEFAULT_TABLE table=test-table [id=c2d69420383543979e63d2d96b808fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:39.892231 22062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c372d6a1df943aaaf589d30d2332de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:39.894940 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.871493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38582 (local address 127.13.139.1:40703)
0810 18:35:39.887682 (+ 16189us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.887694 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.887734 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:35:39.887894 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.887902 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.888151 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.888369 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:39.888960 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.890361 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.892014 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.893454 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.893583 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.893777 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.894453 (+ 676us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.894616 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15968,"thread_start_us":17077,"threads_started":1}
I20260810 18:35:39.894963 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.870877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40703 (local address 127.0.0.1:38582)
0810 18:35:39.881505 (+ 10628us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.881932 (+ 427us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.882064 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.888366 (+ 6302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.888369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.888390 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:39.888779 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.888790 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.890494 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.890497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.891864 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.891876 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.893956 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.893964 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.894250 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.894286 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.894394 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.894527 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10486,"mutex_wait_us":29,"thread_start_us":10905,"threads_started":1}
I20260810 18:35:39.896883 22167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.870198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:45629 (local address 127.0.0.1:33122)
0810 18:35:39.870824 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:39.870847 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:39.870994 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:39.884298 (+ 13304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:39.884307 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:39.884347 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:39.885015 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.885034 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.892434 (+ 7400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.892439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.894206 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:39.894218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.895963 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.895970 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:39.896151 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.896181 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 18:35:39.896294 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 18:35:39.896460 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":32,"thread_start_us":1002,"threads_started":1}
I20260810 18:35:39.898594 21757 tablet_service.cc:1467] Processing CreateTablet for tablet 4c372d6a1df943aaaf589d30d2332de2 (DEFAULT_TABLE table=test-table [id=c2d69420383543979e63d2d96b808fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:39.899869 21757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c372d6a1df943aaaf589d30d2332de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:39.900082 22168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:39.870448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33122 (local address 127.13.139.2:45629)
0810 18:35:39.883591 (+ 13143us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:39.883600 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:39.883630 (+ 30us) server_negotiation.cc:407] Connection header received
0810 18:35:39.883736 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:39.883745 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:39.884028 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:39.884242 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:39.886268 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.888125 (+ 1857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.894352 (+ 6227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:39.895756 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:39.895897 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:39.896102 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:39.899614 (+ 3512us) server_negotiation.cc:299] Negotiation successful
0810 18:35:39.899795 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12933,"thread_start_us":12811,"threads_started":1}
I20260810 18:35:39.903558 21909 tablet_service.cc:1467] Processing CreateTablet for tablet 4c372d6a1df943aaaf589d30d2332de2 (DEFAULT_TABLE table=test-table [id=c2d69420383543979e63d2d96b808fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:39.904935 21909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c372d6a1df943aaaf589d30d2332de2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:39.906942 22172 tablet_bootstrap.cc:492] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Bootstrap starting.
I20260810 18:35:39.911082 22172 tablet_bootstrap.cc:654] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:39.912192 22172 log.cc:824] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:39.914834 22172 tablet_bootstrap.cc:492] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: No bootstrap required, opened a new log
I20260810 18:35:39.915128 22172 ts_tablet_manager.cc:1397] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260810 18:35:39.916327 22174 tablet_bootstrap.cc:492] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Bootstrap starting.
I20260810 18:35:39.919754 22175 tablet_bootstrap.cc:492] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Bootstrap starting.
I20260810 18:35:39.921343 22174 tablet_bootstrap.cc:654] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:39.922670 22174 log.cc:824] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:39.922719 22175 tablet_bootstrap.cc:654] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:39.924009 22175 log.cc:824] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:39.926092 22174 tablet_bootstrap.cc:492] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: No bootstrap required, opened a new log
I20260810 18:35:39.925972 22172 raft_consensus.cc:348] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:39.926395 22174 ts_tablet_manager.cc:1397] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260810 18:35:39.926415 22172 raft_consensus.cc:374] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:39.926518 22172 raft_consensus.cc:729] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00d6393d56f04094a68320314fca78a9, State: Initialized, Role: FOLLOWER
I20260810 18:35:39.926750 22175 tablet_bootstrap.cc:492] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: No bootstrap required, opened a new log
I20260810 18:35:39.927039 22175 ts_tablet_manager.cc:1397] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 18:35:39.927173 22172 consensus_queue.cc:260] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:39.929025 22172 ts_tablet_manager.cc:1428] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Time spent starting tablet: real 0.014s user 0.006s sys 0.009s
I20260810 18:35:39.929333 22133 heartbeater.cc:503] Master 127.13.139.62:39197 was elected leader, sending a full tablet report...
I20260810 18:35:39.936312 22174 raft_consensus.cc:348] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:39.936753 22174 raft_consensus.cc:374] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:39.936857 22174 raft_consensus.cc:729] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26022dbf3568467c983382d03b554443, State: Initialized, Role: FOLLOWER
I20260810 18:35:39.937513 22174 consensus_queue.cc:260] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:39.939267 22174 ts_tablet_manager.cc:1428] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Time spent starting tablet: real 0.013s user 0.007s sys 0.007s
I20260810 18:35:39.939522 22175 raft_consensus.cc:348] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:39.939972 22175 raft_consensus.cc:374] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:39.940081 22175 raft_consensus.cc:729] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c76195126ba54f8387f1c92b6084e738, State: Initialized, Role: FOLLOWER
I20260810 18:35:39.940696 22175 consensus_queue.cc:260] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:39.944123 21983 heartbeater.cc:503] Master 127.13.139.62:39197 was elected leader, sending a full tablet report...
I20260810 18:35:39.944761 22175 ts_tablet_manager.cc:1428] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Time spent starting tablet: real 0.018s user 0.009s sys 0.007s
W20260810 18:35:40.025484 22139 tablet.cc:2369] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:35:40.029592 21827 tablet.cc:2369] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:35:40.108781 22180 raft_consensus.cc:482] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:40.109174 22180 raft_consensus.cc:504] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:40.110951 22180 leader_election.cc:288] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279), 26022dbf3568467c983382d03b554443 (127.13.139.1:40703)
I20260810 18:35:40.118463 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.111377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:42403 (local address 127.13.139.3:34279)
0810 18:35:40.111658 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:40.111667 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:40.112470 (+ 803us) server_negotiation.cc:407] Connection header received
0810 18:35:40.112695 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:40.112698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:40.112756 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:40.112854 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:40.113501 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.114340 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.116367 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.117498 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.117664 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.117743 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:40.118074 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 18:35:40.118208 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260810 18:35:40.118955 22183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.111279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40703 (local address 127.13.139.2:54015)
0810 18:35:40.112249 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:40.112273 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:40.112466 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:40.112793 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:40.112798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:40.112821 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:40.113208 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:40.113218 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.114335 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.114342 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:40.116499 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:40.116513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.118087 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.118093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:40.118249 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.118272 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:35:40.118380 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 18:35:40.118507 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":1,"spinlock_wait_cycles":8576,"thread_start_us":452,"threads_started":1}
I20260810 18:35:40.119256 22184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.111344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:34279 (local address 127.13.139.2:42403)
0810 18:35:40.112340 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:40.112354 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:40.112546 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:40.112871 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:40.112880 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:40.112920 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:40.113332 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:40.113341 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.114497 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.114501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:40.116210 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:40.116222 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.117696 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.117702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:40.117879 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.117914 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:35:40.118647 (+ 733us) client_negotiation.cc:240] Negotiation successful
0810 18:35:40.118784 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":897,"mutex_wait_us":1,"spinlock_wait_cycles":7808,"thread_start_us":720,"threads_started":1}
I20260810 18:35:40.119634 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.111491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:54015 (local address 127.13.139.1:40703)
0810 18:35:40.111866 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:40.111873 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:40.112377 (+ 504us) server_negotiation.cc:407] Connection header received
0810 18:35:40.112619 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:40.112622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:40.112683 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:40.112779 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:40.113354 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.114201 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.116666 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.117871 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.118047 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.118123 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:40.118405 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 18:35:40.119017 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260810 18:35:40.120463 22082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c372d6a1df943aaaf589d30d2332de2" candidate_uuid: "c76195126ba54f8387f1c92b6084e738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00d6393d56f04094a68320314fca78a9" is_pre_election: true
I20260810 18:35:40.120595 21778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c372d6a1df943aaaf589d30d2332de2" candidate_uuid: "c76195126ba54f8387f1c92b6084e738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26022dbf3568467c983382d03b554443" is_pre_election: true
I20260810 18:35:40.121068 22082 raft_consensus.cc:2454] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c76195126ba54f8387f1c92b6084e738 in term 0.
I20260810 18:35:40.121069 21778 raft_consensus.cc:2454] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c76195126ba54f8387f1c92b6084e738 in term 0.
I20260810 18:35:40.121795 21857 leader_election.cc:302] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 00d6393d56f04094a68320314fca78a9, 26022dbf3568467c983382d03b554443, c76195126ba54f8387f1c92b6084e738; no voters:
I20260810 18:35:40.122223 22180 raft_consensus.cc:2781] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:40.122377 22180 raft_consensus.cc:482] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:40.122483 22180 raft_consensus.cc:3037] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:40.125756 22180 raft_consensus.cc:504] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:40.126446 22180 leader_election.cc:288] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [CANDIDATE]: Term 1 election: Requested vote from peers 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279), 26022dbf3568467c983382d03b554443 (127.13.139.1:40703)
I20260810 18:35:40.126901 21778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c372d6a1df943aaaf589d30d2332de2" candidate_uuid: "c76195126ba54f8387f1c92b6084e738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26022dbf3568467c983382d03b554443"
I20260810 18:35:40.126896 22082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c372d6a1df943aaaf589d30d2332de2" candidate_uuid: "c76195126ba54f8387f1c92b6084e738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00d6393d56f04094a68320314fca78a9"
I20260810 18:35:40.127110 22082 raft_consensus.cc:3037] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:40.127120 21778 raft_consensus.cc:3037] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:40.129642 21778 raft_consensus.cc:2454] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c76195126ba54f8387f1c92b6084e738 in term 1.
I20260810 18:35:40.130111 21857 leader_election.cc:302] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26022dbf3568467c983382d03b554443, c76195126ba54f8387f1c92b6084e738; no voters:
I20260810 18:35:40.130342 22082 raft_consensus.cc:2454] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c76195126ba54f8387f1c92b6084e738 in term 1.
I20260810 18:35:40.130385 22180 raft_consensus.cc:2781] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:40.131821 22180 raft_consensus.cc:686] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 1 LEADER]: Becoming Leader. State: Replica: c76195126ba54f8387f1c92b6084e738, State: Running, Role: LEADER
I20260810 18:35:40.132354 22180 consensus_queue.cc:237] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } }
I20260810 18:35:40.137284 20741 catalog_manager.cc:5495] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 reported cstate change: term changed from 0 to 1, leader changed from <none> to c76195126ba54f8387f1c92b6084e738 (127.13.139.2). New cstate: current_term: 1 leader_uuid: "c76195126ba54f8387f1c92b6084e738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } health_report { overall_health: UNKNOWN } } }
W20260810 18:35:40.158350 21985 tablet.cc:2369] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:35:40.175190 22168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.170077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33130 (local address 127.13.139.2:45629)
0810 18:35:40.170338 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:40.170343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:40.170361 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:35:40.170537 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:40.170540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:40.170615 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:40.170737 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:40.171042 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.171757 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.173107 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.173498 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.173591 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.174084 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:40.174575 (+ 491us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:40.174708 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:40.174775 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 18:35:40.174851 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 18:35:40.184056 21778 raft_consensus.cc:1261] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Refusing update from remote peer c76195126ba54f8387f1c92b6084e738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:40.184056 22082 raft_consensus.cc:1261] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 1 FOLLOWER]: Refusing update from remote peer c76195126ba54f8387f1c92b6084e738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:40.185283 22180 consensus_queue.cc:1035] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:40.185629 22186 consensus_queue.cc:1035] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:40.219108 20741 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:40.219465 20741 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:40.225973 20741 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75497e66da0f43bfb17a45857c6a90e3: Sending DeleteTablet for 3 replicas of tablet 4c372d6a1df943aaaf589d30d2332de2
I20260810 18:35:40.227396 21909 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c372d6a1df943aaaf589d30d2332de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:40 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:33122
I20260810 18:35:40.227774 22062 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c372d6a1df943aaaf589d30d2332de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:40 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:54768
I20260810 18:35:40.228504 22203 tablet_replica.cc:330] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: stopping tablet replica
I20260810 18:35:40.228878 21757 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c372d6a1df943aaaf589d30d2332de2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:40 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:38582
I20260810 18:35:40.229301 22204 tablet_replica.cc:330] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: stopping tablet replica
I20260810 18:35:40.232385 22205 tablet_replica.cc:330] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: stopping tablet replica
I20260810 18:35:40.232533 22203 raft_consensus.cc:2229] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:40.232918 22205 raft_consensus.cc:2229] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:40.233368 22203 raft_consensus.cc:2258] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:40.233572 22205 raft_consensus.cc:2258] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:40.235605 22203 ts_tablet_manager.cc:1905] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:40.235844 22205 ts_tablet_manager.cc:1905] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:40.236577 22204 raft_consensus.cc:2229] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:40.237059 22204 raft_consensus.cc:2258] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:40.239938 22204 ts_tablet_manager.cc:1905] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:40.243269 22205 ts_tablet_manager.cc:1918] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:40.243539 22205 log.cc:1196] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/4c372d6a1df943aaaf589d30d2332de2
I20260810 18:35:40.243590 22203 ts_tablet_manager.cc:1918] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:40.243976 22203 log.cc:1196] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/4c372d6a1df943aaaf589d30d2332de2
I20260810 18:35:40.244241 22205 ts_tablet_manager.cc:1939] T 4c372d6a1df943aaaf589d30d2332de2 P 26022dbf3568467c983382d03b554443: Deleting consensus metadata
I20260810 18:35:40.244731 22203 ts_tablet_manager.cc:1939] T 4c372d6a1df943aaaf589d30d2332de2 P c76195126ba54f8387f1c92b6084e738: Deleting consensus metadata
I20260810 18:35:40.246536 20722 catalog_manager.cc:4841] TS 26022dbf3568467c983382d03b554443 (127.13.139.1:40703): tablet 4c372d6a1df943aaaf589d30d2332de2 (table test-table [id=c2d69420383543979e63d2d96b808fa6]) successfully deleted
I20260810 18:35:40.246560 20724 catalog_manager.cc:4841] TS c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629): tablet 4c372d6a1df943aaaf589d30d2332de2 (table test-table [id=c2d69420383543979e63d2d96b808fa6]) successfully deleted
I20260810 18:35:40.249262 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 20706
I20260810 18:35:40.250365 20775 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:40.255649 22204 ts_tablet_manager.cc:1918] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:40.255896 22204 log.cc:1196] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/4c372d6a1df943aaaf589d30d2332de2
I20260810 18:35:40.256471 22204 ts_tablet_manager.cc:1939] T 4c372d6a1df943aaaf589d30d2332de2 P 00d6393d56f04094a68320314fca78a9: Deleting consensus metadata
I20260810 18:35:40.265733 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.230509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38388 (local address 127.13.139.61:37515)
0810 18:35:40.230730 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:40.230740 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:40.248130 (+ 17390us) server_negotiation.cc:407] Connection header received
0810 18:35:40.248445 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:40.248453 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:40.248545 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:40.248624 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:40.251314 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.252207 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.254421 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.255088 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.255183 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.258950 (+ 3767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:40.258957 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:40.258962 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:40.259006 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:40.262643 (+ 3637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.263418 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.263497 (+ 79us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.263502 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.263660 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.264091 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.264098 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.264104 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.264482 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:40.264731 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:40.265129 (+ 398us) server_negotiation.cc:299] Negotiation successful
0810 18:35:40.265363 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 18:35:40.282640 22151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.248240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41610 (local address 127.13.139.60:33907)
0810 18:35:40.248735 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:40.248740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:40.266002 (+ 17262us) server_negotiation.cc:407] Connection header received
0810 18:35:40.266136 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:40.266142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:40.266228 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:40.266332 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:40.268222 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.269339 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.271269 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.271980 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.272082 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.275721 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:40.275729 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:40.275736 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:40.275784 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:40.279555 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.280522 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.280528 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.280532 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.280683 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.281107 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.281113 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.281116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.281500 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:40.281768 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:40.282065 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 18:35:40.282298 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342}
I20260810 18:35:40.379407 20723 catalog_manager.cc:4841] TS 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279): tablet 4c372d6a1df943aaaf589d30d2332de2 (table test-table [id=c2d69420383543979e63d2d96b808fa6]) successfully deleted
I20260810 18:35:40.380127 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 20706
I20260810 18:35:40.431097 22151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.411726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41616 (local address 127.13.139.60:33907)
0810 18:35:40.411923 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:40.411927 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:40.412992 (+ 1065us) server_negotiation.cc:407] Connection header received
0810 18:35:40.413217 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:40.413227 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:40.413336 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:40.413425 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:40.418144 (+ 4719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.418883 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.420669 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.421354 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.421489 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.424162 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:40.424167 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:40.424170 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:40.424203 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:40.427948 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.428890 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.428896 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.428900 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.429055 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.429572 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.429580 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.429586 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.429950 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:40.430114 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:40.430591 (+ 477us) server_negotiation.cc:299] Negotiation successful
0810 18:35:40.430795 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 18:35:40.431602 22137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:40.410495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38390 (local address 127.13.139.61:37515)
0810 18:35:40.410749 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:40.410758 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:40.412140 (+ 1382us) server_negotiation.cc:407] Connection header received
0810 18:35:40.413160 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:40.413168 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:40.413256 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:40.413347 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:40.415710 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.416851 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.419040 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:40.419747 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:40.419872 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:40.424694 (+ 4822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:40.424704 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:40.424714 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:40.424763 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:40.428340 (+ 3577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.429157 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.429165 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.429171 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.429336 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:40.429791 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:40.429796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:40.429799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:40.430172 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:40.430412 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:40.430999 (+ 587us) server_negotiation.cc:299] Negotiation successful
0810 18:35:40.431232 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 18:35:41.206475 22216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.205536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.2:36445)
0810 18:35:41.206094 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.206255 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":269,"threads_started":1}
W20260810 18:35:41.207100 21983 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:39197 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
I20260810 18:35:41.210059 22217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.208785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:57765)
0810 18:35:41.209684 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.209837 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":809,"thread_start_us":717,"threads_started":1}
W20260810 18:35:41.210541 22133 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:39197 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
I20260810 18:35:41.212864 22218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.212247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.1:46915)
0810 18:35:41.212625 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.212726 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":206,"threads_started":1}
W20260810 18:35:41.213266 21825 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:39197 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
I20260810 18:35:41.727137 22219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75497e66da0f43bfb17a45857c6a90e3)
I20260810 18:35:41.727414 22219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } }
I20260810 18:35:41.727555 22220 raft_consensus.cc:482] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 75497e66da0f43bfb17a45857c6a90e3)
I20260810 18:35:41.727842 22220 raft_consensus.cc:504] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } }
I20260810 18:35:41.728386 22219 leader_election.cc:288] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197), e12e2a2154434cca8d7a7a758116c771 (127.13.139.60:33907)
I20260810 18:35:41.729338 22220 leader_election.cc:288] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197), 5d10378a66d64da690b1345a896b6c61 (127.13.139.61:37515)
I20260810 18:35:41.730113 22221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.728554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37192)
0810 18:35:41.729595 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.729818 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":913,"thread_start_us":1171,"threads_started":1}
I20260810 18:35:41.730643 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.729420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37200)
0810 18:35:41.729997 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.730317 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":299,"threads_started":1}
W20260810 18:35:41.730970 21607 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
W20260810 18:35:41.731678 21395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
I20260810 18:35:41.741674 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.729536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:37515 (local address 127.0.0.1:38392)
0810 18:35:41.730253 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.730286 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:41.730433 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:41.732564 (+ 2131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:41.732572 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:41.732612 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:41.733030 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.733044 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.735138 (+ 2094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.735146 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.738050 (+ 2904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.738072 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.740515 (+ 2443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.740525 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.740820 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.740876 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 18:35:41.741009 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 18:35:41.741209 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":1015,"threads_started":1}
I20260810 18:35:41.742096 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.730961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38392 (local address 127.13.139.61:37515)
0810 18:35:41.731737 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:41.731746 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:41.731774 (+ 28us) server_negotiation.cc:407] Connection header received
0810 18:35:41.731963 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:41.731974 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:41.732082 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:41.732203 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:41.733286 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.734919 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.738319 (+ 3400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.740059 (+ 1740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.740233 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.740391 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:41.741576 (+ 1185us) server_negotiation.cc:299] Negotiation successful
0810 18:35:41.741736 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":396,"threads_started":1}
I20260810 18:35:41.743415 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.742997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37210)
0810 18:35:41.743168 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.743271 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 18:35:41.743185 21423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e12e2a2154434cca8d7a7a758116c771" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5d10378a66d64da690b1345a896b6c61" is_pre_election: true
I20260810 18:35:41.743674 21423 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12e2a2154434cca8d7a7a758116c771 in term 1.
I20260810 18:35:41.743806 22226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.743113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37220)
0810 18:35:41.743295 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.743565 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 18:35:41.743721 21607 leader_election.cc:334] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197): Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
W20260810 18:35:41.744047 21395 leader_election.cc:334] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197): Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
I20260810 18:35:41.744470 21612 leader_election.cc:302] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d10378a66d64da690b1345a896b6c61, e12e2a2154434cca8d7a7a758116c771; no voters: 75497e66da0f43bfb17a45857c6a90e3
I20260810 18:35:41.744875 22220 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 18:35:41.745015 22220 raft_consensus.cc:482] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 75497e66da0f43bfb17a45857c6a90e3)
I20260810 18:35:41.745182 22220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 1 FOLLOWER]: Advancing to term 2
I20260810 18:35:41.748363 22220 raft_consensus.cc:504] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } }
I20260810 18:35:41.749140 22220 leader_election.cc:288] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [CANDIDATE]: Term 2 election: Requested vote from peers 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197), 5d10378a66d64da690b1345a896b6c61 (127.13.139.61:37515)
I20260810 18:35:41.749363 22221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.730122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:33907 (local address 127.0.0.1:41626)
0810 18:35:41.730315 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.730334 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:41.730465 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:41.742981 (+ 12516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:41.742987 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:41.743045 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:41.743449 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.743469 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.745233 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.745239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.747246 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.747262 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.748563 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.748571 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.748758 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.748790 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 18:35:41.748939 (+ 149us) client_negotiation.cc:240] Negotiation successful
0810 18:35:41.749090 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":626,"threads_started":1}
I20260810 18:35:41.749744 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.749265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37228)
0810 18:35:41.749410 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.749605 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 18:35:41.749770 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.730605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41626 (local address 127.13.139.60:33907)
0810 18:35:41.741731 (+ 11126us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:41.741740 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:41.741765 (+ 25us) server_negotiation.cc:407] Connection header received
0810 18:35:41.741840 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:41.741848 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:41.741954 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:41.743710 (+ 1756us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:41.744147 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.745075 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.747409 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.748388 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.748484 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.748573 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:41.749037 (+ 464us) server_negotiation.cc:299] Negotiation successful
0810 18:35:41.749190 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10951,"thread_start_us":10800,"threads_started":1}
I20260810 18:35:41.749835 21423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e12e2a2154434cca8d7a7a758116c771" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5d10378a66d64da690b1345a896b6c61"
I20260810 18:35:41.750062 21423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 1 FOLLOWER]: Advancing to term 2
I20260810 18:35:41.750887 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.750525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37230)
0810 18:35:41.750673 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.750755 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 18:35:41.751072 21607 leader_election.cc:334] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197): Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
I20260810 18:35:41.751641 21636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d10378a66d64da690b1345a896b6c61" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e12e2a2154434cca8d7a7a758116c771" is_pre_election: true
I20260810 18:35:41.751997 21636 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d10378a66d64da690b1345a896b6c61 in current term 2: Already voted for candidate e12e2a2154434cca8d7a7a758116c771 in this term.
I20260810 18:35:41.752578 21395 leader_election.cc:302] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d10378a66d64da690b1345a896b6c61; no voters: 75497e66da0f43bfb17a45857c6a90e3, e12e2a2154434cca8d7a7a758116c771
I20260810 18:35:41.752780 21423 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12e2a2154434cca8d7a7a758116c771 in term 2.
I20260810 18:35:41.753005 22219 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 18:35:41.753177 21612 leader_election.cc:302] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d10378a66d64da690b1345a896b6c61, e12e2a2154434cca8d7a7a758116c771; no voters: 75497e66da0f43bfb17a45857c6a90e3
I20260810 18:35:41.753484 22220 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 18:35:41.753886 22220 raft_consensus.cc:686] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [term 2 LEADER]: Becoming Leader. State: Replica: e12e2a2154434cca8d7a7a758116c771, State: Running, Role: LEADER
I20260810 18:35:41.754256 22220 consensus_queue.cc:237] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } }
I20260810 18:35:41.756237 22231 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e12e2a2154434cca8d7a7a758116c771. Latest consensus state: current_term: 2 leader_uuid: "e12e2a2154434cca8d7a7a758116c771" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:41.756619 22231 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:41.757392 22233 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:41.761343 22233 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:41.762182 22233 catalog_manager.cc:1259] Loaded cluster ID: 3dae4da720d4462392e7b6458fbd6ab0
I20260810 18:35:41.762253 22233 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:41.763345 22233 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:41.764335 22233 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Loaded TSK: 0
I20260810 18:35:41.765501 22233 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:35:41.827546 21625 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:41.834751 21625 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:41.839044 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.838577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37260)
0810 18:35:41.838778 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.838880 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 18:35:41.839214 21423 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [term 2 FOLLOWER]: Refusing update from remote peer e12e2a2154434cca8d7a7a758116c771: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260810 18:35:41.840011 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.839671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37268)
0810 18:35:41.839816 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.839889 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 18:35:41.840193 22231 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260810 18:35:41.840485 21607 consensus_peers.cc:487] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 -> Peer 75497e66da0f43bfb17a45857c6a90e3 (127.13.139.62:39197): Couldn't send request to peer 75497e66da0f43bfb17a45857c6a90e3. Status: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 18:35:41.842757 22219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e12e2a2154434cca8d7a7a758116c771. Latest consensus state: current_term: 2 leader_uuid: "e12e2a2154434cca8d7a7a758116c771" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:41.843026 22219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:41.844944 22231 sys_catalog.cc:455] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "e12e2a2154434cca8d7a7a758116c771" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:41.845255 22235 mvcc.cc:205] Tried to move back new op lower bound from 7317040913766215680 to 7317040913429524480. Current Snapshot: MvccSnapshot[applied={T|T < 7317040913766215680}]
I20260810 18:35:41.845289 22231 sys_catalog.cc:458] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771 [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:41.851987 22219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "e12e2a2154434cca8d7a7a758116c771" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "75497e66da0f43bfb17a45857c6a90e3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39197 } } peers { permanent_uuid: "5d10378a66d64da690b1345a896b6c61" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 37515 } attrs { promote: false } } peers { permanent_uuid: "e12e2a2154434cca8d7a7a758116c771" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 33907 } attrs { promote: false } } }
I20260810 18:35:41.852288 22219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d10378a66d64da690b1345a896b6c61 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:35:41.864053 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.856436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40703 (local address 127.0.0.1:38598)
0810 18:35:41.856586 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.856602 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:41.856748 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:41.857576 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:41.857584 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:41.857613 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:41.857880 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.857897 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.859241 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.859249 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.861413 (+ 2164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.861430 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.863115 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.863121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.863310 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.863387 (+ 77us) client_negotiation.cc:769] Sending connection context
0810 18:35:41.863507 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 18:35:41.863641 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 18:35:41.864869 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.856805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38598 (local address 127.13.139.1:40703)
0810 18:35:41.857241 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:41.857247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:41.857265 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:35:41.857341 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:41.857346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:41.857423 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:41.858042 (+ 619us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:41.858213 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.859088 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.861579 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.862938 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.863082 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.863210 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:41.864395 (+ 1185us) server_negotiation.cc:299] Negotiation successful
0810 18:35:41.864544 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":910,"threads_started":1}
I20260810 18:35:41.865585 21757 tablet_service.cc:1467] Processing CreateTablet for tablet 34ffd77d50c740daa6c169de29a9a7f9 (DEFAULT_TABLE table=test-table [id=f267827065744d5f94446de636df14e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:41.866032 21757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34ffd77d50c740daa6c169de29a9a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:41.867194 22222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.857181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:45629 (local address 127.0.0.1:33134)
0810 18:35:41.857549 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.857566 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:41.857641 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:41.861276 (+ 3635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:41.861281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:41.861307 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:41.861669 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.861677 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.862947 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.862955 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.865120 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.865134 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.866709 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.866713 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.866839 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.866862 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:35:41.866913 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 18:35:41.867002 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239}
I20260810 18:35:41.867967 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.857565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33134 (local address 127.13.139.2:45629)
0810 18:35:41.860954 (+ 3389us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:41.860960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:41.860978 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:35:41.861050 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:41.861058 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:41.861135 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:41.861237 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:41.861820 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.862781 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.865274 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.866475 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.867463 (+ 988us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.867557 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:41.867608 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 18:35:41.867712 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3255,"thread_start_us":3147,"threads_started":1}
I20260810 18:35:41.868798 21909 tablet_service.cc:1467] Processing CreateTablet for tablet 34ffd77d50c740daa6c169de29a9a7f9 (DEFAULT_TABLE table=test-table [id=f267827065744d5f94446de636df14e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:41.869227 22241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.857291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:34279 (local address 127.0.0.1:54784)
0810 18:35:41.858199 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.858215 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:41.858329 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:41.860462 (+ 2133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:41.860466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:41.860490 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:41.860954 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.860968 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.862523 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.862529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.866473 (+ 3944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:41.866488 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.868387 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.868394 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:41.868577 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.868609 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 18:35:41.868696 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 18:35:41.868821 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"mutex_wait_us":1767,"thread_start_us":632,"threads_started":1}
I20260810 18:35:41.869282 21909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34ffd77d50c740daa6c169de29a9a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:41.869881 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.857865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54784 (local address 127.13.139.3:34279)
0810 18:35:41.860087 (+ 2222us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:41.860093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:41.860114 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:35:41.860198 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:41.860203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:41.860292 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:41.860451 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:41.861149 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.862275 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.866640 (+ 4365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:41.868002 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:41.868129 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:41.868237 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:41.869420 (+ 1183us) server_negotiation.cc:299] Negotiation successful
0810 18:35:41.869587 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2092,"thread_start_us":1985,"threads_started":1}
I20260810 18:35:41.870630 22062 tablet_service.cc:1467] Processing CreateTablet for tablet 34ffd77d50c740daa6c169de29a9a7f9 (DEFAULT_TABLE table=test-table [id=f267827065744d5f94446de636df14e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:41.871075 22062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34ffd77d50c740daa6c169de29a9a7f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:41.872469 22244 tablet_bootstrap.cc:492] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: Bootstrap starting.
I20260810 18:35:41.873970 22244 tablet_bootstrap.cc:654] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:41.876194 22244 tablet_bootstrap.cc:492] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: No bootstrap required, opened a new log
I20260810 18:35:41.876413 22244 ts_tablet_manager.cc:1397] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 18:35:41.876612 22247 tablet_bootstrap.cc:492] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: Bootstrap starting.
I20260810 18:35:41.877405 22244 raft_consensus.cc:348] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:41.877763 22244 raft_consensus.cc:374] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:41.877913 22244 raft_consensus.cc:729] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26022dbf3568467c983382d03b554443, State: Initialized, Role: FOLLOWER
I20260810 18:35:41.878142 22248 tablet_bootstrap.cc:492] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: Bootstrap starting.
I20260810 18:35:41.878347 22247 tablet_bootstrap.cc:654] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:41.878335 22244 consensus_queue.cc:260] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:41.879196 22244 ts_tablet_manager.cc:1428] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:41.880056 22248 tablet_bootstrap.cc:654] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:41.882375 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.879870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.1:56449)
0810 18:35:41.881897 (+ 2027us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.882097 (+ 200us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1864,"thread_start_us":1690,"threads_started":1}
I20260810 18:35:41.882440 22248 tablet_bootstrap.cc:492] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: No bootstrap required, opened a new log
I20260810 18:35:41.882599 22248 ts_tablet_manager.cc:1397] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 18:35:41.883442 22248 raft_consensus.cc:348] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:41.883741 22248 raft_consensus.cc:374] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:41.883751 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.883209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.1:56003)
0810 18:35:41.883417 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.883526 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260810 18:35:41.883854 22248 raft_consensus.cc:729] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00d6393d56f04094a68320314fca78a9, State: Initialized, Role: FOLLOWER
I20260810 18:35:41.884150 22248 consensus_queue.cc:260] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:41.885198 22247 tablet_bootstrap.cc:492] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: No bootstrap required, opened a new log
I20260810 18:35:41.885349 22247 ts_tablet_manager.cc:1397] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260810 18:35:41.885452 21824 heartbeater.cc:503] Master 127.13.139.60:33907 was elected leader, sending a full tablet report...
I20260810 18:35:41.886315 22248 ts_tablet_manager.cc:1428] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 18:35:41.886896 22247 raft_consensus.cc:348] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:41.887151 22247 raft_consensus.cc:374] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:41.887266 22247 raft_consensus.cc:729] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c76195126ba54f8387f1c92b6084e738, State: Initialized, Role: FOLLOWER
I20260810 18:35:41.887547 22247 consensus_queue.cc:260] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:41.889014 22247 ts_tablet_manager.cc:1428] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 18:35:41.891031 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.889566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.2:57687)
0810 18:35:41.890104 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.890277 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":276,"threads_started":1}
I20260810 18:35:41.892104 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.885349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:56645)
0810 18:35:41.890846 (+ 5497us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.891799 (+ 953us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5365,"thread_start_us":5230,"threads_started":1}
I20260810 18:35:41.893029 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.892698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:33861)
0810 18:35:41.892828 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.892910 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 18:35:41.893136 22132 heartbeater.cc:503] Master 127.13.139.60:33907 was elected leader, sending a full tablet report...
I20260810 18:35:41.893599 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:41.892830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.2:54487)
0810 18:35:41.893350 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:41.893436 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411}
I20260810 18:35:41.893663 21982 heartbeater.cc:503] Master 127.13.139.60:33907 was elected leader, sending a full tablet report...
I20260810 18:35:42.048944 22253 raft_consensus.cc:482] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:42.049208 22253 raft_consensus.cc:504] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:42.050737 22253 leader_election.cc:288] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26022dbf3568467c983382d03b554443 (127.13.139.1:40703), c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629)
I20260810 18:35:42.056836 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.051168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:59295 (local address 127.13.139.1:40703)
0810 18:35:42.051444 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:42.051450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:42.051471 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:35:42.051678 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:42.051682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:42.051743 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:42.051851 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:42.052370 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.053189 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.055048 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.055899 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.056092 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.056170 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:42.056448 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 18:35:42.056573 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 18:35:42.056879 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.051075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:40703 (local address 127.13.139.3:59295)
0810 18:35:42.051298 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.051320 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:42.051504 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:42.051873 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:42.051878 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:42.051909 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:42.052214 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:42.052225 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.053333 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.053340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:42.054883 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:42.054900 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.056097 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.056104 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:42.056280 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.056304 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 18:35:42.056420 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 18:35:42.056557 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 18:35:42.057456 21778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ffd77d50c740daa6c169de29a9a7f9" candidate_uuid: "00d6393d56f04094a68320314fca78a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26022dbf3568467c983382d03b554443" is_pre_election: true
I20260810 18:35:42.057623 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.051353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:39549 (local address 127.13.139.2:45629)
0810 18:35:42.051601 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:42.051607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:42.052353 (+ 746us) server_negotiation.cc:407] Connection header received
0810 18:35:42.052545 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:42.052552 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:42.052617 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:42.052738 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:42.053247 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.053988 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.055659 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.056572 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.056749 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.056822 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:42.057225 (+ 403us) server_negotiation.cc:299] Negotiation successful
0810 18:35:42.057362 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260810 18:35:42.057602 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.051082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:45629 (local address 127.13.139.3:39549)
0810 18:35:42.052248 (+ 1166us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.052261 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:42.052400 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:42.052763 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:42.052768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:42.052790 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:42.053097 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:42.053105 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.054120 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.054128 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:42.055523 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:42.055535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.056764 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.056770 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:42.057061 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.057091 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 18:35:42.057187 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 18:35:42.057311 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1059,"mutex_wait_us":376,"thread_start_us":485,"threads_started":1}
I20260810 18:35:42.057723 21778 raft_consensus.cc:2454] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00d6393d56f04094a68320314fca78a9 in term 0.
I20260810 18:35:42.058250 22012 leader_election.cc:302] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00d6393d56f04094a68320314fca78a9, 26022dbf3568467c983382d03b554443; no voters:
I20260810 18:35:42.058691 22253 raft_consensus.cc:2781] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:42.058832 22253 raft_consensus.cc:482] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:42.058682 21931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ffd77d50c740daa6c169de29a9a7f9" candidate_uuid: "00d6393d56f04094a68320314fca78a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c76195126ba54f8387f1c92b6084e738" is_pre_election: true
I20260810 18:35:42.058950 22253 raft_consensus.cc:3037] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:42.059129 21931 raft_consensus.cc:2454] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00d6393d56f04094a68320314fca78a9 in term 0.
I20260810 18:35:42.061272 22253 raft_consensus.cc:504] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:42.061827 22253 leader_election.cc:288] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [CANDIDATE]: Term 1 election: Requested vote from peers 26022dbf3568467c983382d03b554443 (127.13.139.1:40703), c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629)
I20260810 18:35:42.062353 21778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ffd77d50c740daa6c169de29a9a7f9" candidate_uuid: "00d6393d56f04094a68320314fca78a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26022dbf3568467c983382d03b554443"
I20260810 18:35:42.062506 21931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34ffd77d50c740daa6c169de29a9a7f9" candidate_uuid: "00d6393d56f04094a68320314fca78a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c76195126ba54f8387f1c92b6084e738"
I20260810 18:35:42.062556 21778 raft_consensus.cc:3037] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:42.062728 21931 raft_consensus.cc:3037] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:42.064750 21778 raft_consensus.cc:2454] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00d6393d56f04094a68320314fca78a9 in term 1.
I20260810 18:35:42.064930 21931 raft_consensus.cc:2454] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00d6393d56f04094a68320314fca78a9 in term 1.
I20260810 18:35:42.065200 22012 leader_election.cc:302] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00d6393d56f04094a68320314fca78a9, 26022dbf3568467c983382d03b554443; no voters:
I20260810 18:35:42.065519 22253 raft_consensus.cc:2781] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:42.065964 22253 raft_consensus.cc:686] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 1 LEADER]: Becoming Leader. State: Replica: 00d6393d56f04094a68320314fca78a9, State: Running, Role: LEADER
I20260810 18:35:42.066377 22253 consensus_queue.cc:237] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } }
I20260810 18:35:42.066915 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.066527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:38769)
0810 18:35:42.066695 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.066797 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 18:35:42.070245 21624 catalog_manager.cc:5495] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00d6393d56f04094a68320314fca78a9 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "00d6393d56f04094a68320314fca78a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00d6393d56f04094a68320314fca78a9" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 34279 } health_report { overall_health: HEALTHY } } }
I20260810 18:35:42.102265 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.096730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54794 (local address 127.13.139.3:34279)
0810 18:35:42.096958 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:42.096962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:42.096979 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:35:42.097086 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:42.097090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:42.097187 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:42.097322 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:42.097652 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.098437 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.099912 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.100348 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.100512 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.100951 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:42.101586 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:42.101780 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:42.101897 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 18:35:42.101986 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260810 18:35:42.106729 21778 raft_consensus.cc:1261] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Refusing update from remote peer 00d6393d56f04094a68320314fca78a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:42.107120 21931 raft_consensus.cc:1261] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 1 FOLLOWER]: Refusing update from remote peer 00d6393d56f04094a68320314fca78a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:42.107569 22259 consensus_queue.cc:1035] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26022dbf3568467c983382d03b554443" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:42.108014 22253 consensus_queue.cc:1035] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c76195126ba54f8387f1c92b6084e738" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:42.110806 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.110093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.1:44775)
0810 18:35:42.110374 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.110547 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260810 18:35:42.111971 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.111223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.2:42985)
0810 18:35:42.111620 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.111747 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289}
I20260810 18:35:42.115515 22262 mvcc.cc:205] Tried to move back new op lower bound from 7317040914861707264 to 7317040914707877888. Current Snapshot: MvccSnapshot[applied={T|T < 7317040914861707264}]
I20260810 18:35:42.120462 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.119985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:56771)
0810 18:35:42.120167 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.120271 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 18:35:42.121452 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.120886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.1:49297)
0810 18:35:42.121141 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.121246 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
I20260810 18:35:42.129441 21625 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:42.129707 21625 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:42.134508 22258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.133596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.3:40727)
0810 18:35:42.134130 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.134266 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375}
I20260810 18:35:42.135560 22263 mvcc.cc:205] Tried to move back new op lower bound from 7317040914861707264 to 7317040914707877888. Current Snapshot: MvccSnapshot[applied={T|T < 7317040914861707264 or (T in {7317040914861707264})}]
I20260810 18:35:42.139400 21625 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e12e2a2154434cca8d7a7a758116c771: Sending DeleteTablet for 3 replicas of tablet 34ffd77d50c740daa6c169de29a9a7f9
I20260810 18:35:42.140832 22062 tablet_service.cc:1514] Processing DeleteTablet for tablet 34ffd77d50c740daa6c169de29a9a7f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:42 UTC) from {username='oryx', principal='oryx/127.13.139.60@KRBTEST.COM'} at 127.0.0.1:54784
I20260810 18:35:42.140939 21757 tablet_service.cc:1514] Processing DeleteTablet for tablet 34ffd77d50c740daa6c169de29a9a7f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:42 UTC) from {username='oryx', principal='oryx/127.13.139.60@KRBTEST.COM'} at 127.0.0.1:38598
I20260810 18:35:42.141508 21909 tablet_service.cc:1514] Processing DeleteTablet for tablet 34ffd77d50c740daa6c169de29a9a7f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:42 UTC) from {username='oryx', principal='oryx/127.13.139.60@KRBTEST.COM'} at 127.0.0.1:33134
I20260810 18:35:42.142526 22256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.142026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.13.139.2:33867)
0810 18:35:42.142264 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.142355 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260810 18:35:42.145128 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 21592
I20260810 18:35:42.155679 22274 tablet_replica.cc:330] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: stopping tablet replica
I20260810 18:35:42.155898 22274 raft_consensus.cc:2229] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:42.157058 22274 raft_consensus.cc:2258] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:42.161130 22275 tablet_replica.cc:330] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: stopping tablet replica
I20260810 18:35:42.163844 22273 tablet_replica.cc:330] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: stopping tablet replica
I20260810 18:35:42.164067 22273 raft_consensus.cc:2229] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:42.168236 22275 raft_consensus.cc:2229] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:42.169780 22274 ts_tablet_manager.cc:1905] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:42.170903 22275 raft_consensus.cc:2258] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:42.172680 22275 ts_tablet_manager.cc:1905] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:42.175714 22273 raft_consensus.cc:2258] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:42.176170 22274 ts_tablet_manager.cc:1918] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:42.176323 22274 log.cc:1196] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/34ffd77d50c740daa6c169de29a9a7f9
I20260810 18:35:42.176818 22274 ts_tablet_manager.cc:1939] T 34ffd77d50c740daa6c169de29a9a7f9 P 26022dbf3568467c983382d03b554443: Deleting consensus metadata
I20260810 18:35:42.176971 22273 ts_tablet_manager.cc:1905] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:42.178097 21607 catalog_manager.cc:4841] TS 26022dbf3568467c983382d03b554443 (127.13.139.1:40703): tablet 34ffd77d50c740daa6c169de29a9a7f9 (table test-table [id=f267827065744d5f94446de636df14e8]) successfully deleted
I20260810 18:35:42.184263 22273 ts_tablet_manager.cc:1918] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:42.184479 22273 log.cc:1196] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/34ffd77d50c740daa6c169de29a9a7f9
I20260810 18:35:42.185086 22273 ts_tablet_manager.cc:1939] T 34ffd77d50c740daa6c169de29a9a7f9 P 00d6393d56f04094a68320314fca78a9: Deleting consensus metadata
I20260810 18:35:42.185204 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.147819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.13.139.1:40703)
0810 18:35:42.147989 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:42.147995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:42.162440 (+ 14445us) server_negotiation.cc:407] Connection header received
0810 18:35:42.162773 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:42.162782 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:42.162862 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:42.162987 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:42.165147 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.166254 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.173355 (+ 7101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.174058 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.174167 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.178413 (+ 4246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:42.178430 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:42.178448 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:42.178509 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:42.181842 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:42.182683 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:42.182692 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:42.182696 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:42.182833 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:42.183286 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:42.183292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:42.183295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:42.183874 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:42.184228 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:42.184514 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 18:35:42.184797 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 18:35:42.185982 21818 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:42.188913 22275 ts_tablet_manager.cc:1918] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:42.189088 22275 log.cc:1196] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/34ffd77d50c740daa6c169de29a9a7f9
I20260810 18:35:42.189618 22275 ts_tablet_manager.cc:1939] T 34ffd77d50c740daa6c169de29a9a7f9 P c76195126ba54f8387f1c92b6084e738: Deleting consensus metadata
I20260810 18:35:42.190111 21608 catalog_manager.cc:4841] TS 00d6393d56f04094a68320314fca78a9 (127.13.139.3:34279): tablet 34ffd77d50c740daa6c169de29a9a7f9 (table test-table [id=f267827065744d5f94446de636df14e8]) successfully deleted
I20260810 18:35:42.190809 21610 catalog_manager.cc:4841] TS c76195126ba54f8387f1c92b6084e738 (127.13.139.2:45629): tablet 34ffd77d50c740daa6c169de29a9a7f9 (table test-table [id=f267827065744d5f94446de636df14e8]) successfully deleted
I20260810 18:35:42.281514 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 21592
I20260810 18:35:42.302413 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 21837
I20260810 18:35:42.318229 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.303275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33138 (local address 127.13.139.2:45629)
0810 18:35:42.303492 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:42.303498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:42.303528 (+ 30us) server_negotiation.cc:407] Connection header received
0810 18:35:42.303726 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:42.303732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:42.303817 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:42.303934 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:42.305346 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.306544 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.307968 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.308594 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.308717 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.311265 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:42.311282 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:42.311302 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:42.311352 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:42.315302 (+ 3950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:42.316112 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:42.316122 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:42.316125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:42.316279 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:42.316644 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:42.316649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:42.316653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:42.317103 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:42.317420 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:42.317579 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 18:35:42.317830 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:35:42.318907 21975 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:42.423847 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.422997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37274)
0810 18:35:42.423522 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.423633 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":256,"threads_started":1}
I20260810 18:35:42.425441 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.424982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:39197 (local address 127.0.0.1:37288)
0810 18:35:42.425164 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:42.425276 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:39197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 18:35:42.443614 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 21837
I20260810 18:35:42.478612 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 21995
I20260810 18:35:42.495365 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:42.479522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54808 (local address 127.13.139.3:34279)
0810 18:35:42.479706 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:42.479710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:42.479728 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:35:42.479966 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:42.479972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:42.480069 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:42.480161 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:42.482097 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.482931 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.484807 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:42.485267 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:42.485377 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:42.488833 (+ 3456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:42.488862 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:42.488888 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:42.488927 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:42.492483 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:42.493180 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:42.493188 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:42.493190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:42.493352 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:42.493792 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:42.493804 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:42.493806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:42.494176 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:42.494524 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:42.494761 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 18:35:42.494993 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:35:42.496310 22127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:42.628690 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 21995
I20260810 18:35:42.652254 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 21250
I20260810 18:35:42.653400 21446 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:42.774053 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 21250
I20260810 18:35:42.799530 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 21365
I20260810 18:35:42.800695 21656 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:42.931556 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 21365
2026-08-10T18:35:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10040 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:43 dist-test-slave-5k54 krb5kdc[22287](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:43 dist-test-slave-5k54 krb5kdc[22287](info): set up 2 sockets
Aug 10 18:35:43 dist-test-slave-5k54 krb5kdc[22287](info): commencing operation
krb5kdc: starting...
W20260810 18:35:44.115355 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:44 dist-test-slave-5k54 krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:44Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab.
Entry for principal oryx/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab.
I20260810 18:35:44.362537 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:38005
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab
--principal=oryx/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:38005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:44.690616 22301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:44.690989 22301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:44.691155 22301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:44.698632 22301 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:44.698786 22301 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 18:35:44.698887 22301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:44.699023 22301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:44.699116 22301 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:44.699206 22301 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:44.709547 22301 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:38005
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.62.keytab
--principal=oryx/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:38005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:44.710983 22301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:44.712460 22301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:44.724592 22306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:44.724467 22309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:44.724591 22307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:44.725821 22301 server_base.cc:1034] running on GCE node
I20260810 18:35:44.726555 22301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:44.728046 22301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:44.729275 22301 hybrid_clock.cc:648] HybridClock initialized: now 1786386944729205 us; error 44 us; skew 500 ppm
I20260810 18:35:44.729641 22301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:44 dist-test-slave-5k54 krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386944, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:44.733007 22301 init.cc:377] Logged in from keytab as oryx/127.13.139.62@KRBTEST.COM (short username oryx)
I20260810 18:35:44.734445 22301 webserver.cc:460] Webserver started at http://127.13.139.62:38851/ using document root <none> and password file <none>
I20260810 18:35:44.735127 22301 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:44.735214 22301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:44.735548 22301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:44.738559 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "6a89f600efcc43cd9890ef7c4dc4141f"
format_stamp: "Formatted at 2026-08-10 18:35:44 on dist-test-slave-5k54"
server_key: "4460066e054ac4603b46ee13a25bb654"
server_key_iv: "983f1b19dc605ed250451704406098b5"
server_key_version: "encryptionkey@0"
I20260810 18:35:44.739326 22301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "6a89f600efcc43cd9890ef7c4dc4141f"
format_stamp: "Formatted at 2026-08-10 18:35:44 on dist-test-slave-5k54"
server_key: "4460066e054ac4603b46ee13a25bb654"
server_key_iv: "983f1b19dc605ed250451704406098b5"
server_key_version: "encryptionkey@0"
I20260810 18:35:44.744556 22301 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260810 18:35:44.747948 22316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:44.749293 22301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:35:44.749478 22301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "6a89f600efcc43cd9890ef7c4dc4141f"
format_stamp: "Formatted at 2026-08-10 18:35:44 on dist-test-slave-5k54"
server_key: "4460066e054ac4603b46ee13a25bb654"
server_key_iv: "983f1b19dc605ed250451704406098b5"
server_key_version: "encryptionkey@0"
I20260810 18:35:44.749715 22301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:44.768664 22301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:44.772688 22301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:44.772967 22301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:44.794898 22301 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:38005
I20260810 18:35:44.794936 22385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:38005 every 8 connection(s)
I20260810 18:35:44.796305 22301 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:44.800204 22386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:44.805049 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 22301
I20260810 18:35:44.805269 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:44.805950 13868 external_mini_cluster.cc:1428] Setting key 6e4a2c442f60ee4a116cc43988719c7e
I20260810 18:35:44.812019 22386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Bootstrap starting.
I20260810 18:35:44.815976 22386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:44.817001 22386 log.cc:824] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:44.819939 22386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: No bootstrap required, opened a new log
Aug 10 18:35:44 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:44.827881 22386 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38005 } }
I20260810 18:35:44.828297 22386 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:44.828433 22386 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a89f600efcc43cd9890ef7c4dc4141f, State: Initialized, Role: FOLLOWER
I20260810 18:35:44.829172 22386 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38005 } }
I20260810 18:35:44.829537 22386 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:44.829708 22386 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:44.829988 22386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:44.830704 22389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:44.808048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37472 (local address 127.13.139.62:38005)
0810 18:35:44.808973 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:44.808989 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:44.809051 (+ 62us) server_negotiation.cc:407] Connection header received
0810 18:35:44.811527 (+ 2476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:44.811559 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:44.812085 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:44.812545 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:44.813909 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:44.815967 (+ 2058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:44.817286 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:44.818440 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:44.818637 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:44.822737 (+ 4100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:44.822745 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:44.822759 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:44.822805 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:44.825965 (+ 3160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:44.826681 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:44.826691 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:44.826703 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:44.826881 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:44.827285 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:44.827291 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:44.827294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:44.827923 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:44.828235 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:44.828689 (+ 454us) server_negotiation.cc:299] Negotiation successful
0810 18:35:44.829308 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":390,"threads_started":1}
I20260810 18:35:44.832556 22386 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38005 } }
I20260810 18:35:44.833088 22386 leader_election.cc:302] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a89f600efcc43cd9890ef7c4dc4141f; no voters:
I20260810 18:35:44.833740 22386 leader_election.cc:288] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:44.833860 22391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:44.834543 22391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [term 1 LEADER]: Becoming Leader. State: Replica: 6a89f600efcc43cd9890ef7c4dc4141f, State: Running, Role: LEADER
I20260810 18:35:44.835168 22391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38005 } }
I20260810 18:35:44.836050 22386 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:44.838044 22393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a89f600efcc43cd9890ef7c4dc4141f. Latest consensus state: current_term: 1 leader_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38005 } } }
I20260810 18:35:44.838450 22393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:44.838346 22392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a89f600efcc43cd9890ef7c4dc4141f" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 38005 } } }
I20260810 18:35:44.838863 22392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:44.839994 22399 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:44.846654 22399 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:44.859723 22399 catalog_manager.cc:1347] Generated new cluster ID: 9c6a3707500f4b84afd2d50cbd6aa62c
I20260810 18:35:44.859906 22399 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:44.884680 22399 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:44.886147 22399 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:44.892514 22399 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Generated new TSK 0
I20260810 18:35:44.893304 22399 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab.
Entry for principal oryx/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab.
I20260810 18:35:44.967569 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38005
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab
--principal=oryx/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:45.306005 22415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:45.306277 22415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:45.306377 22415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:45.313549 22415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:45.313650 22415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:45.313733 22415 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:35:45.313820 22415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:45.323580 22415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab
--principal=oryx/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:38005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:45.324906 22415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:45.326171 22415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:45.339354 22420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:45.339394 22423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:45.339327 22421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:45.340610 22415 server_base.cc:1034] running on GCE node
I20260810 18:35:45.341243 22415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:45.342193 22415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:45.343500 22415 hybrid_clock.cc:648] HybridClock initialized: now 1786386945343377 us; error 65 us; skew 500 ppm
I20260810 18:35:45.343801 22415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:45 dist-test-slave-5k54 krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386945, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:45.347222 22415 init.cc:377] Logged in from keytab as oryx/127.13.139.1@KRBTEST.COM (short username oryx)
I20260810 18:35:45.348747 22415 webserver.cc:460] Webserver started at http://127.13.139.1:34071/ using document root <none> and password file <none>
I20260810 18:35:45.349462 22415 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:45.349603 22415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:45.349927 22415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:45.352837 22415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "7352312061434c01a1b63267fcb275d8"
format_stamp: "Formatted at 2026-08-10 18:35:45 on dist-test-slave-5k54"
server_key: "901f43bc4fcc8ba077f99284f26ac9a1"
server_key_iv: "903860c4114c6a258c07c805a26f415b"
server_key_version: "encryptionkey@0"
I20260810 18:35:45.353701 22415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "7352312061434c01a1b63267fcb275d8"
format_stamp: "Formatted at 2026-08-10 18:35:45 on dist-test-slave-5k54"
server_key: "901f43bc4fcc8ba077f99284f26ac9a1"
server_key_iv: "903860c4114c6a258c07c805a26f415b"
server_key_version: "encryptionkey@0"
I20260810 18:35:45.358795 22415 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 18:35:45.362275 22430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:45.363612 22415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:45.363780 22415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "7352312061434c01a1b63267fcb275d8"
format_stamp: "Formatted at 2026-08-10 18:35:45 on dist-test-slave-5k54"
server_key: "901f43bc4fcc8ba077f99284f26ac9a1"
server_key_iv: "903860c4114c6a258c07c805a26f415b"
server_key_version: "encryptionkey@0"
I20260810 18:35:45.364013 22415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:45.399127 22415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:45.403746 22415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:45.404024 22415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:45.406728 22415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:45.406836 22415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:45.407009 22415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:45.407086 22415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:35:45 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386945, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:45.430692 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.407458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:38557 (local address 127.13.139.62:38005)
0810 18:35:45.408039 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:45.408045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:45.409226 (+ 1181us) server_negotiation.cc:407] Connection header received
0810 18:35:45.412295 (+ 3069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:45.412304 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:45.412409 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:45.412574 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:45.415211 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.416225 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.419465 (+ 3240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.420007 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.420143 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:45.424063 (+ 3920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:45.424067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:45.424071 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:45.424103 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:45.426873 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:45.427652 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:45.427660 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:45.427666 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:45.427820 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:45.428465 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:45.428470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:45.428474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:45.428744 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:45.428866 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:45.430008 (+ 1142us) server_negotiation.cc:299] Negotiation successful
0810 18:35:45.430278 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":324,"threads_started":1}
I20260810 18:35:45.432574 22440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.408148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38005 (local address 127.13.139.1:38557)
0810 18:35:45.409022 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:45.409084 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:45.411945 (+ 2861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:45.412902 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:45.412934 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:45.413944 (+ 1010us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:45.414981 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.415017 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.416487 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.416496 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:45.419271 (+ 2775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.419295 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.420352 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.420359 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:45.420554 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:45.421330 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:45.421350 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:45.423836 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:45.427017 (+ 3181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:45.427026 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:45.427040 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:45.427535 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:45.427974 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:45.427980 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:45.427984 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:45.428311 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:45.428879 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:45.428889 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:45.429461 (+ 572us) client_negotiation.cc:769] Sending connection context
0810 18:35:45.429849 (+ 388us) client_negotiation.cc:240] Negotiation successful
0810 18:35:45.430533 (+ 684us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":328,"threads_started":1}
I20260810 18:35:45.459738 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.442413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:34975 (local address 127.13.139.62:38005)
0810 18:35:45.442644 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:45.442651 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:45.443599 (+ 948us) server_negotiation.cc:407] Connection header received
0810 18:35:45.443823 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:45.443832 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:45.443933 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:45.444047 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:45.445279 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.446566 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.449021 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.449799 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.449950 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:45.452247 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:45.452257 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:45.452265 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:45.452319 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:45.456124 (+ 3805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:45.457357 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:45.457363 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:45.457366 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:45.457541 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:45.458052 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:45.458057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:45.458059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:45.458409 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:45.458576 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:45.458994 (+ 418us) server_negotiation.cc:299] Negotiation successful
0810 18:35:45.459254 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 18:35:45.459856 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.442529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38005 (local address 127.13.139.1:34975)
0810 18:35:45.443403 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:45.443480 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:45.443662 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:45.444094 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:45.444097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:45.444770 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:45.445072 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.445081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.446718 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.446728 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:45.448836 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.448853 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.450038 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.450048 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:45.450277 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:45.451098 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:45.451115 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:45.452014 (+ 899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:45.456316 (+ 4302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:45.456325 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:45.456332 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:45.457160 (+ 828us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:45.457692 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:45.457699 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:45.457719 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:45.457913 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:45.458526 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:45.458529 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:45.458683 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 18:35:45.458825 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 18:35:45.459213 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":474,"threads_started":1}
I20260810 18:35:45.460386 22415 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:39309
I20260810 18:35:45.460424 22562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:39309 every 8 connection(s)
I20260810 18:35:45.461964 22415 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:45.464078 22563 heartbeater.cc:347] Connected to a master server at 127.13.139.62:38005
I20260810 18:35:45.464335 22563 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:45.464931 22563 heartbeater.cc:511] Master 127.13.139.62:38005 requested a full tablet report, sending...
I20260810 18:35:45.466794 22334 ts_manager.cc:194] Registered new tserver with Master: 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309)
I20260810 18:35:45.466871 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 22415
I20260810 18:35:45.467097 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:45.467896 13868 external_mini_cluster.cc:1428] Setting key ba35699665e6a18a5dd3b8aed840e38b
I20260810 18:35:45.468578 22334 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:38557
WARNING: no policy specified for oryx/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab.
Entry for principal oryx/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab.
I20260810 18:35:45.527149 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38005
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab
--principal=oryx/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:45.861079 22567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:45.861377 22567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:45.861529 22567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:45.869277 22567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:45.869393 22567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:45.869478 22567 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:35:45.869558 22567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:45.879601 22567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab
--principal=oryx/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:38005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:45.880985 22567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:45.882332 22567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:45.895926 22573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:45.895900 22574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:45.895983 22576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:45.896849 22567 server_base.cc:1034] running on GCE node
I20260810 18:35:45.897439 22567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:45.898370 22567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:45.899636 22567 hybrid_clock.cc:648] HybridClock initialized: now 1786386945899556 us; error 57 us; skew 500 ppm
I20260810 18:35:45.900089 22567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:45 dist-test-slave-5k54 krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386945, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:45.904417 22567 init.cc:377] Logged in from keytab as oryx/127.13.139.2@KRBTEST.COM (short username oryx)
I20260810 18:35:45.906628 22567 webserver.cc:460] Webserver started at http://127.13.139.2:44085/ using document root <none> and password file <none>
I20260810 18:35:45.907716 22567 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:45.907853 22567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:45.908290 22567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:45.912809 22567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
format_stamp: "Formatted at 2026-08-10 18:35:45 on dist-test-slave-5k54"
server_key: "22cb85544cf0dfc6301e5e0e946ecbaf"
server_key_iv: "a6c494c0af04ad2b96b292b1a1391497"
server_key_version: "encryptionkey@0"
I20260810 18:35:45.913826 22567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
format_stamp: "Formatted at 2026-08-10 18:35:45 on dist-test-slave-5k54"
server_key: "22cb85544cf0dfc6301e5e0e946ecbaf"
server_key_iv: "a6c494c0af04ad2b96b292b1a1391497"
server_key_version: "encryptionkey@0"
I20260810 18:35:45.920981 22567 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260810 18:35:45.924551 22583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:45.925855 22567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:35:45.926028 22567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
format_stamp: "Formatted at 2026-08-10 18:35:45 on dist-test-slave-5k54"
server_key: "22cb85544cf0dfc6301e5e0e946ecbaf"
server_key_iv: "a6c494c0af04ad2b96b292b1a1391497"
server_key_version: "encryptionkey@0"
I20260810 18:35:45.926214 22567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:45.950987 22567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:45.955327 22567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:45.955649 22567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:45.958334 22567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:45.958474 22567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:45.958624 22567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:45.958698 22567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:35:45 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386945, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:45.983127 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.959624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:40775 (local address 127.13.139.62:38005)
0810 18:35:45.959814 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:45.959819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:45.960937 (+ 1118us) server_negotiation.cc:407] Connection header received
0810 18:35:45.963108 (+ 2171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:45.963115 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:45.963215 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:45.963349 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:45.965974 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.967045 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.969892 (+ 2847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.970666 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.970834 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:45.975204 (+ 4370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:45.975213 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:45.975219 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:45.975273 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:45.978936 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:45.979968 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:45.979973 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:45.979979 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:45.980114 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:45.980603 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:45.980615 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:45.980618 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:45.980931 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:45.981115 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:45.982367 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0810 18:35:45.982651 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 18:35:45.985112 22593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.959863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38005 (local address 127.13.139.2:40775)
0810 18:35:45.960764 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:45.960805 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:45.962819 (+ 2014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:45.963665 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:45.963682 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:45.964563 (+ 881us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:45.965751 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.965796 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.967285 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.967292 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:45.969673 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.969713 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.970970 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.970977 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:45.971152 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:45.971970 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:45.972016 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:45.974949 (+ 2933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:45.979096 (+ 4147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:45.979105 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:45.979127 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:45.979824 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:45.980238 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:45.980243 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:45.980246 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:45.980462 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:45.981090 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:45.981103 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:45.981741 (+ 638us) client_negotiation.cc:769] Sending connection context
0810 18:35:45.982195 (+ 454us) client_negotiation.cc:240] Negotiation successful
0810 18:35:45.982978 (+ 783us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":395,"threads_started":1}
I20260810 18:35:46.005893 22711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:42281 every 8 connection(s)
I20260810 18:35:46.005925 22567 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:42281
I20260810 18:35:46.007608 22567 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:46.009766 22712 heartbeater.cc:347] Connected to a master server at 127.13.139.62:38005
I20260810 18:35:46.009896 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.993251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:57549 (local address 127.13.139.62:38005)
0810 18:35:45.993471 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:45.993479 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:45.993980 (+ 501us) server_negotiation.cc:407] Connection header received
0810 18:35:45.994194 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:45.994202 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:45.994296 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:45.994401 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:45.996213 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.996947 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.999183 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.999780 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.999914 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:46.002841 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:46.002851 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:46.002859 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:46.002909 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:46.006672 (+ 3763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:46.007331 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:46.007336 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:46.007340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:46.007559 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:46.007967 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:46.007972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:46.007976 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:46.008514 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:46.008673 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:46.009310 (+ 637us) server_negotiation.cc:299] Negotiation successful
0810 18:35:46.009545 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:35:46.010079 22712 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:46.010058 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:45.992782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38005 (local address 127.13.139.2:57549)
0810 18:35:45.993858 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:45.993880 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:45.994056 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:45.994464 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:45.994475 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:45.995506 (+ 1031us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:45.996059 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.996073 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.997101 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:45.997110 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:45.999037 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:45.999049 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:45.999994 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.000000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:46.000140 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:46.000930 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:46.000950 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:46.002558 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:46.006802 (+ 4244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:46.006805 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:46.006808 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:46.007206 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:46.007693 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:46.007697 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:46.007700 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:46.007847 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:46.008753 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:46.008764 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:46.009016 (+ 252us) client_negotiation.cc:769] Sending connection context
0810 18:35:46.009210 (+ 194us) client_negotiation.cc:240] Negotiation successful
0810 18:35:46.009538 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"thread_start_us":794,"threads_started":1}
I20260810 18:35:46.010936 22712 heartbeater.cc:511] Master 127.13.139.62:38005 requested a full tablet report, sending...
I20260810 18:35:46.012424 22332 ts_manager.cc:194] Registered new tserver with Master: c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281)
I20260810 18:35:46.013273 22332 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:40775
I20260810 18:35:46.014454 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 22567
I20260810 18:35:46.014631 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:46.015208 13868 external_mini_cluster.cc:1428] Setting key 08e1af7e66daf5ec1a347424be44e185
WARNING: no policy specified for oryx/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab.
Entry for principal oryx/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab.
I20260810 18:35:46.071508 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:38005
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab
--principal=oryx/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:46.398770 22717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:46.399042 22717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:46.399214 22717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:46.406421 22717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:46.406551 22717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:46.406708 22717 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 18:35:46.406847 22717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:46.416519 22717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab
--principal=oryx/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.139.62:38005
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:46.417802 22717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:46.419134 22717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:46.432173 22723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:46.432142 22724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:46.432111 22726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:46.432940 22717 server_base.cc:1034] running on GCE node
I20260810 18:35:46.433552 22717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:46.434631 22717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:46.435889 22717 hybrid_clock.cc:648] HybridClock initialized: now 1786386946435834 us; error 32 us; skew 500 ppm
I20260810 18:35:46.436146 22717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:46 dist-test-slave-5k54 krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386946, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:46.439468 22717 init.cc:377] Logged in from keytab as oryx/127.13.139.3@KRBTEST.COM (short username oryx)
I20260810 18:35:46.440845 22717 webserver.cc:460] Webserver started at http://127.13.139.3:44425/ using document root <none> and password file <none>
I20260810 18:35:46.441497 22717 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:46.441582 22717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:46.441864 22717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:46.444751 22717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "f9a8949750b64485801d08b6414bb7b8"
format_stamp: "Formatted at 2026-08-10 18:35:46 on dist-test-slave-5k54"
server_key: "61b03fae93d7fb05f404951811c1edb7"
server_key_iv: "ffbcabf896aee8558e9d634860b7c4cc"
server_key_version: "encryptionkey@0"
I20260810 18:35:46.445502 22717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "f9a8949750b64485801d08b6414bb7b8"
format_stamp: "Formatted at 2026-08-10 18:35:46 on dist-test-slave-5k54"
server_key: "61b03fae93d7fb05f404951811c1edb7"
server_key_iv: "ffbcabf896aee8558e9d634860b7c4cc"
server_key_version: "encryptionkey@0"
I20260810 18:35:46.450529 22717 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260810 18:35:46.453991 22733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:46.455368 22717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:46.455577 22717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "f9a8949750b64485801d08b6414bb7b8"
format_stamp: "Formatted at 2026-08-10 18:35:46 on dist-test-slave-5k54"
server_key: "61b03fae93d7fb05f404951811c1edb7"
server_key_iv: "ffbcabf896aee8558e9d634860b7c4cc"
server_key_version: "encryptionkey@0"
I20260810 18:35:46.455799 22717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:46.471274 22563 heartbeater.cc:503] Master 127.13.139.62:38005 was elected leader, sending a full tablet report...
I20260810 18:35:46.471321 22717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:46.475723 22717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:46.475955 22717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:46.478375 22717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:46.478452 22717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:46.478631 22717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:46.478693 22717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:35:46 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386946, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:46.506091 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:46.479028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:46977 (local address 127.13.139.62:38005)
0810 18:35:46.479277 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:46.479286 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:46.480734 (+ 1448us) server_negotiation.cc:407] Connection header received
0810 18:35:46.483782 (+ 3048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:46.483788 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:46.483877 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:46.484013 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:46.486415 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.487797 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.490627 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.491225 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.491346 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:46.497598 (+ 6252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:46.497607 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:46.497615 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:46.497665 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:46.501994 (+ 4329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:46.503273 (+ 1279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:46.503281 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:46.503287 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:46.503504 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:46.504110 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:46.504116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:46.504122 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:46.504496 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:46.504656 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:46.505470 (+ 814us) server_negotiation.cc:299] Negotiation successful
0810 18:35:46.505717 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:35:46.507220 22742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:46.479670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38005 (local address 127.13.139.3:46977)
0810 18:35:46.480553 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:46.480602 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:46.483408 (+ 2806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:46.484340 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:46.484355 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:46.485226 (+ 871us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:46.486193 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:46.486237 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.487993 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.488002 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:46.490426 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:46.490440 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.491672 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.491682 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:46.492016 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:46.493393 (+ 1377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:46.493418 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:46.497251 (+ 3833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:46.502207 (+ 4956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:46.502225 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:46.502251 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:46.503120 (+ 869us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:46.503674 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:46.503678 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:46.503680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:46.503930 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:46.504650 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:46.504658 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:46.505055 (+ 397us) client_negotiation.cc:769] Sending connection context
0810 18:35:46.505336 (+ 281us) client_negotiation.cc:240] Negotiation successful
0810 18:35:46.505902 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":351,"threads_started":1}
I20260810 18:35:46.527331 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:46.513568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:33953 (local address 127.13.139.62:38005)
0810 18:35:46.513719 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:46.513723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:46.514529 (+ 806us) server_negotiation.cc:407] Connection header received
0810 18:35:46.514769 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:46.514777 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:46.514883 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:46.514977 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:46.516604 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.517691 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.519047 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.519561 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.519689 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:46.521792 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:46.521803 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:46.521806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:46.521836 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:46.524664 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:46.525350 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:46.525356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:46.525360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:46.525499 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:46.525865 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:46.525870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:46.525874 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:46.526149 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:46.526306 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:46.526742 (+ 436us) server_negotiation.cc:299] Negotiation successful
0810 18:35:46.526969 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:35:46.527804 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:46.513680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38005 (local address 127.13.139.3:33953)
0810 18:35:46.514427 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:46.514442 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:46.514605 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:46.515178 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:46.515182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:46.515911 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:46.516432 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:46.516455 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.517842 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.517850 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:46.518899 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:46.518917 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.519781 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.519788 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:46.519951 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:46.520658 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:46.520686 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:46.521585 (+ 899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:46.524820 (+ 3235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:46.524826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:46.524831 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:46.525223 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:46.525614 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:46.525619 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:46.525623 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:46.525757 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:46.526271 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:46.526276 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:46.526481 (+ 205us) client_negotiation.cc:769] Sending connection context
0810 18:35:46.526640 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 18:35:46.527017 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":420,"threads_started":1}
I20260810 18:35:46.534672 22717 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:41571
I20260810 18:35:46.534693 22863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:41571 every 8 connection(s)
I20260810 18:35:46.536129 22717 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:46.538359 22864 heartbeater.cc:347] Connected to a master server at 127.13.139.62:38005
I20260810 18:35:46.538590 22864 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:46.539240 22864 heartbeater.cc:511] Master 127.13.139.62:38005 requested a full tablet report, sending...
I20260810 18:35:46.540652 22332 ts_manager.cc:194] Registered new tserver with Master: f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571)
I20260810 18:35:46.541461 22332 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:46977
I20260810 18:35:46.546512 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 22717
I20260810 18:35:46.546658 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:46.547130 13868 external_mini_cluster.cc:1428] Setting key 4b9a1584b9fdd12fde2ebf323bebc79d
I20260810 18:35:46.549983 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 18:35:46 dist-test-slave-5k54 krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386946, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 18:35:46 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:46 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:47.016170 22712 heartbeater.cc:503] Master 127.13.139.62:38005 was elected leader, sending a full tablet report...
I20260810 18:35:47.543777 22864 heartbeater.cc:503] Master 127.13.139.62:38005 was elected leader, sending a full tablet report...
W20260810 18:35:47.701135 22872 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.099s user 0.000s sys 0.018s
W20260810 18:35:47.702533 22439 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:46.596654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37484 (local address 127.13.139.62:38005)
0810 18:35:46.596895 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:46.596902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:46.597140 (+ 238us) server_negotiation.cc:407] Connection header received
0810 18:35:46.597361 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:46.597367 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:46.597453 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:46.597565 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:46.598901 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.599744 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.601024 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:46.601437 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:46.601573 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.702188 (+1100615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37484: BlockingRecv error: recv got EOF from 127.0.0.1:37484 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 10 18:35:47 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386946, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:47.724529 22439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.706000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.13.139.62:38005)
0810 18:35:47.706177 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.706182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.706576 (+ 394us) server_negotiation.cc:407] Connection header received
0810 18:35:47.706727 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.706731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.706809 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.706917 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:47.708159 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.708894 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.710201 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.710633 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.710736 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.719503 (+ 8767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:47.719510 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:47.719513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:47.719548 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:47.722151 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:47.722781 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:47.722786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:47.722788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:47.722915 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:47.723250 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:47.723254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:47.723256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:47.723599 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:47.723852 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.724121 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.724298 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:35:47.728618 22332 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:47.735920 22332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:47.767364 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.749074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:41571 (local address 127.0.0.1:47308)
0810 18:35:47.749621 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:47.749642 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:47.749813 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:47.759820 (+ 10007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:47.759828 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:47.759857 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:47.760556 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.760571 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.762629 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.762636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.764621 (+ 1985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.764634 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.766219 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.766225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.766418 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.766479 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 18:35:47.766643 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 18:35:47.766832 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":200,"thread_start_us":1314,"threads_started":1}
I20260810 18:35:47.767802 22888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.749382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47308 (local address 127.13.139.3:41571)
0810 18:35:47.759144 (+ 9762us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.759153 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.759180 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:35:47.759262 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.759267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.759520 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.759796 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:47.760885 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.762480 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.764793 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.766012 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.766165 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.766394 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.767241 (+ 847us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.767457 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9524,"thread_start_us":9375,"threads_started":1}
I20260810 18:35:47.767908 22885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.748045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:39309 (local address 127.0.0.1:33424)
0810 18:35:47.748915 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:47.748963 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:47.755166 (+ 6203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:47.760129 (+ 4963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:47.760135 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:47.760183 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:47.760940 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.760949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.762679 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.762687 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.765429 (+ 2742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.765437 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.767091 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.767098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.767267 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.767310 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 18:35:47.767387 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 18:35:47.767545 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":232,"thread_start_us":339,"threads_started":1}
I20260810 18:35:47.768801 22886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.748281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33424 (local address 127.13.139.1:39309)
0810 18:35:47.759516 (+ 11235us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.759529 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.759551 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:35:47.759660 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.759670 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.759903 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.760261 (+ 358us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:47.761137 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.762512 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.765615 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.766833 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.768143 (+ 1310us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.768330 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.768410 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.768524 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11051,"thread_start_us":10901,"threads_started":1}
I20260810 18:35:47.769200 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.749860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58784 (local address 127.13.139.2:42281)
0810 18:35:47.750480 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.750489 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.758855 (+ 8366us) server_negotiation.cc:407] Connection header received
0810 18:35:47.759193 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.759203 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.759521 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.759710 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:47.761105 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.762572 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.765585 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.767582 (+ 1997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.767713 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.767952 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.768673 (+ 721us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.768839 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":335,"threads_started":1}
I20260810 18:35:47.769371 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.749493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:42281 (local address 127.0.0.1:58784)
0810 18:35:47.758716 (+ 9223us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:47.758739 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:47.758982 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:47.760020 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:47.760024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:47.760075 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:47.760928 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.760941 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.762678 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.762685 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.765418 (+ 2733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.765434 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.768311 (+ 2877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.768318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.768486 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.768516 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 18:35:47.768611 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 18:35:47.768730 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9100,"mutex_wait_us":224,"spinlock_wait_cycles":2432,"thread_start_us":8980,"threads_started":1}
I20260810 18:35:47.771792 22789 tablet_service.cc:1467] Processing CreateTablet for tablet f3aa4d0b48344693b6e37d9a18be1749 (DEFAULT_TABLE table=test-table [id=858e935f1bb44a22824d7d240e138d85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:47.771952 22482 tablet_service.cc:1467] Processing CreateTablet for tablet f3aa4d0b48344693b6e37d9a18be1749 (DEFAULT_TABLE table=test-table [id=858e935f1bb44a22824d7d240e138d85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:47.773304 22482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3aa4d0b48344693b6e37d9a18be1749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:47.773312 22789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3aa4d0b48344693b6e37d9a18be1749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:47.773888 22636 tablet_service.cc:1467] Processing CreateTablet for tablet f3aa4d0b48344693b6e37d9a18be1749 (DEFAULT_TABLE table=test-table [id=858e935f1bb44a22824d7d240e138d85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:47.775142 22636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3aa4d0b48344693b6e37d9a18be1749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:47.784062 22891 tablet_bootstrap.cc:492] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Bootstrap starting.
I20260810 18:35:47.787614 22892 tablet_bootstrap.cc:492] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Bootstrap starting.
I20260810 18:35:47.787695 22891 tablet_bootstrap.cc:654] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:47.789209 22893 tablet_bootstrap.cc:492] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Bootstrap starting.
I20260810 18:35:47.790607 22891 log.cc:824] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:47.791244 22892 tablet_bootstrap.cc:654] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:47.792168 22893 tablet_bootstrap.cc:654] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:47.792486 22892 log.cc:824] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:47.793241 22893 log.cc:824] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:47.793900 22891 tablet_bootstrap.cc:492] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: No bootstrap required, opened a new log
I20260810 18:35:47.794193 22891 ts_tablet_manager.cc:1397] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260810 18:35:47.795265 22892 tablet_bootstrap.cc:492] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: No bootstrap required, opened a new log
I20260810 18:35:47.795563 22892 ts_tablet_manager.cc:1397] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 18:35:47.803707 22892 raft_consensus.cc:348] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.804152 22892 raft_consensus.cc:374] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:47.804203 22893 tablet_bootstrap.cc:492] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: No bootstrap required, opened a new log
I20260810 18:35:47.804255 22892 raft_consensus.cc:729] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9a8949750b64485801d08b6414bb7b8, State: Initialized, Role: FOLLOWER
I20260810 18:35:47.804622 22893 ts_tablet_manager.cc:1397] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.005s
I20260810 18:35:47.805069 22892 consensus_queue.cc:260] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.805740 22891 raft_consensus.cc:348] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.806133 22891 raft_consensus.cc:374] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:47.806221 22891 raft_consensus.cc:729] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Initialized, Role: FOLLOWER
I20260810 18:35:47.806854 22891 consensus_queue.cc:260] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.813171 22892 ts_tablet_manager.cc:1428] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Time spent starting tablet: real 0.017s user 0.006s sys 0.010s
I20260810 18:35:47.817667 22891 ts_tablet_manager.cc:1428] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Time spent starting tablet: real 0.023s user 0.012s sys 0.008s
I20260810 18:35:47.818660 22893 raft_consensus.cc:348] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.819157 22893 raft_consensus.cc:374] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:47.819268 22893 raft_consensus.cc:729] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3aaeef3463a42e9b5811c1bf73f3325, State: Initialized, Role: FOLLOWER
I20260810 18:35:47.820084 22893 consensus_queue.cc:260] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.821808 22893 ts_tablet_manager.cc:1428] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
I20260810 18:35:47.901297 22900 raft_consensus.cc:482] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:47.901681 22900 raft_consensus.cc:504] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.902595 22899 raft_consensus.cc:482] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:47.902925 22899 raft_consensus.cc:504] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.903810 22900 leader_election.cc:288] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571), c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281)
I20260810 18:35:47.908169 22899 leader_election.cc:288] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309), c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281)
I20260810 18:35:47.914820 22886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.905654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:49317 (local address 127.13.139.1:39309)
0810 18:35:47.905894 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.905902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.905939 (+ 37us) server_negotiation.cc:407] Connection header received
0810 18:35:47.906142 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.906146 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.906243 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.906317 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:47.908395 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.909645 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.912382 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.913608 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.913736 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.913815 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.914432 (+ 617us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.914576 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:35:47.914958 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.904400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:55297 (local address 127.13.139.2:42281)
0810 18:35:47.904716 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.904725 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.907461 (+ 2736us) server_negotiation.cc:407] Connection header received
0810 18:35:47.907726 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.907731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.907842 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.907910 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:47.908895 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.909927 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.912627 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.913836 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.913969 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.914052 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.914591 (+ 539us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.914724 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260810 18:35:47.915598 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.905262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:39309 (local address 127.13.139.3:49317)
0810 18:35:47.905870 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:47.905888 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:47.905995 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:47.906525 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:47.906533 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:47.906561 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:47.908216 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.908235 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.909844 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.909849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.912192 (+ 2343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.912206 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.914050 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.914060 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.914249 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.914282 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 18:35:47.915079 (+ 797us) client_negotiation.cc:240] Negotiation successful
0810 18:35:47.915247 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":690,"threads_started":1}
I20260810 18:35:47.916234 22903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.904056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:41571 (local address 127.13.139.1:60191)
0810 18:35:47.905281 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:47.905297 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:47.905475 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:47.906082 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:47.906089 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:47.906130 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:47.906661 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.906677 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.909380 (+ 2703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.909388 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.912536 (+ 3148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.912557 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.915020 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.915029 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.915272 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.915322 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 18:35:47.915452 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 18:35:47.915648 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1110,"mutex_wait_us":29,"spinlock_wait_cycles":21888,"thread_start_us":3012,"threads_started":1}
I20260810 18:35:47.916287 22888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.904421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:60191 (local address 127.13.139.3:41571)
0810 18:35:47.904645 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.904654 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.905396 (+ 742us) server_negotiation.cc:407] Connection header received
0810 18:35:47.905678 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.905688 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.905793 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.905862 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:47.906841 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.909155 (+ 2314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.912781 (+ 3626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.914500 (+ 1719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.914658 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.914760 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.915764 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.915965 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 18:35:47.916606 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7352312061434c01a1b63267fcb275d8" is_pre_election: true
I20260810 18:35:47.917085 22902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.904256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:42281 (local address 127.13.139.1:55297)
0810 18:35:47.907335 (+ 3079us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:47.907353 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:47.907537 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:47.908161 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:47.908165 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:47.908192 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:47.908707 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.908719 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.910140 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.910146 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.912454 (+ 2308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.912468 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.914230 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.914236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.914413 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.914455 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 18:35:47.915451 (+ 996us) client_negotiation.cc:240] Negotiation successful
0810 18:35:47.915585 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2973,"mutex_wait_us":6,"thread_start_us":702,"threads_started":1}
I20260810 18:35:47.917114 22512 raft_consensus.cc:2454] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9a8949750b64485801d08b6414bb7b8 in term 0.
I20260810 18:35:47.917557 22816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8" is_pre_election: true
I20260810 18:35:47.917886 22734 leader_election.cc:302] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7352312061434c01a1b63267fcb275d8, f9a8949750b64485801d08b6414bb7b8; no voters:
I20260810 18:35:47.918146 22816 raft_consensus.cc:2454] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 0.
I20260810 18:35:47.918416 22656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" is_pre_election: true
I20260810 18:35:47.918907 22431 leader_election.cc:302] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7352312061434c01a1b63267fcb275d8, f9a8949750b64485801d08b6414bb7b8; no voters:
I20260810 18:35:47.919000 22656 raft_consensus.cc:2454] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 0.
I20260810 18:35:47.919287 22899 raft_consensus.cc:2781] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:47.919344 22900 raft_consensus.cc:2781] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:47.919485 22899 raft_consensus.cc:482] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:47.919548 22900 raft_consensus.cc:482] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:47.919601 22899 raft_consensus.cc:3037] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:47.919667 22900 raft_consensus.cc:3037] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:47.921904 22900 raft_consensus.cc:504] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.923015 22816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8"
I20260810 18:35:47.923010 22656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
I20260810 18:35:47.923234 22656 raft_consensus.cc:3037] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:47.922946 22899 raft_consensus.cc:504] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.923619 22816 raft_consensus.cc:2379] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7352312061434c01a1b63267fcb275d8 in current term 1: Already voted for candidate f9a8949750b64485801d08b6414bb7b8 in this term.
I20260810 18:35:47.924136 22899 leader_election.cc:288] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 election: Requested vote from peers 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309), c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281)
I20260810 18:35:47.924741 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7352312061434c01a1b63267fcb275d8"
I20260810 18:35:47.925034 22512 raft_consensus.cc:2379] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f9a8949750b64485801d08b6414bb7b8 in current term 1: Already voted for candidate 7352312061434c01a1b63267fcb275d8 in this term.
I20260810 18:35:47.925401 22900 leader_election.cc:288] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 election: Requested vote from peers f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571), c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281)
I20260810 18:35:47.926016 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.907608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:42281 (local address 127.13.139.3:57471)
0810 18:35:47.918408 (+ 10800us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:47.918429 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:47.918554 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:47.918844 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:47.918848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:47.918875 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:47.919185 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.919203 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.921092 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.921097 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.923057 (+ 1960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:47.923095 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.925266 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.925271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:47.925483 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.925523 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 18:35:47.925631 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 18:35:47.925790 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9964,"thread_start_us":12290,"threads_started":1}
I20260810 18:35:47.926162 22905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.907216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:57471 (local address 127.13.139.2:42281)
0810 18:35:47.907919 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.907925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.918591 (+ 10666us) server_negotiation.cc:407] Connection header received
0810 18:35:47.918663 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.918668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.918740 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.918829 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:47.919544 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.920913 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.923318 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.924852 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.925067 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.925171 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.925673 (+ 502us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.925832 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":458,"threads_started":1}
I20260810 18:35:47.926929 22654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
I20260810 18:35:47.926862 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3aa4d0b48344693b6e37d9a18be1749" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" is_pre_election: true
I20260810 18:35:47.927376 22656 raft_consensus.cc:2454] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 1.
I20260810 18:35:47.927753 22737 leader_election.cc:302] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9a8949750b64485801d08b6414bb7b8; no voters: 7352312061434c01a1b63267fcb275d8, c3aaeef3463a42e9b5811c1bf73f3325
I20260810 18:35:47.927791 22434 leader_election.cc:302] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7352312061434c01a1b63267fcb275d8, c3aaeef3463a42e9b5811c1bf73f3325; no voters: f9a8949750b64485801d08b6414bb7b8
I20260810 18:35:47.928088 22899 raft_consensus.cc:2726] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 18:35:47.928297 22900 raft_consensus.cc:2781] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:47.928761 22900 raft_consensus.cc:686] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 1 LEADER]: Becoming Leader. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Running, Role: LEADER
I20260810 18:35:47.929222 22900 consensus_queue.cc:237] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } }
I20260810 18:35:47.934449 22334 catalog_manager.cc:5495] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7352312061434c01a1b63267fcb275d8 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } health_report { overall_health: UNKNOWN } } }
I20260810 18:35:47.951174 22886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:47.945914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33430 (local address 127.13.139.1:39309)
0810 18:35:47.946127 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:47.946134 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:47.946153 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:35:47.946357 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:47.946361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:47.946464 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:47.946616 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:47.946992 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.947777 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.949057 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:47.949464 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:47.949596 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:47.950041 (+ 445us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:47.950550 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:47.950707 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:47.950788 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 18:35:47.950869 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 18:35:47.959053 22656 raft_consensus.cc:1261] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Refusing update from remote peer 7352312061434c01a1b63267fcb275d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:47.959103 22816 raft_consensus.cc:1261] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Refusing update from remote peer 7352312061434c01a1b63267fcb275d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:47.959961 22907 consensus_queue.cc:1035] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:47.960332 22900 consensus_queue.cc:1035] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 18:35:47.966476 22564 tablet.cc:2369] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:35:47.972029 22911 mvcc.cc:205] Tried to move back new op lower bound from 7317040938831470592 to 7317040938722136064. Current Snapshot: MvccSnapshot[applied={T|T < 7317040938831470592}]
I20260810 18:35:47.978333 22912 mvcc.cc:205] Tried to move back new op lower bound from 7317040938831470592 to 7317040938722136064. Current Snapshot: MvccSnapshot[applied={T|T < 7317040938831470592}]
I20260810 18:35:47.988754 22332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:47.989034 22332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:47.992717 22332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Sending DeleteTablet for 3 replicas of tablet f3aa4d0b48344693b6e37d9a18be1749
I20260810 18:35:47.993764 22482 tablet_service.cc:1514] Processing DeleteTablet for tablet f3aa4d0b48344693b6e37d9a18be1749 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:47 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:33424
I20260810 18:35:47.993952 22636 tablet_service.cc:1514] Processing DeleteTablet for tablet f3aa4d0b48344693b6e37d9a18be1749 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:47 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 18:35:47.993939 22789 tablet_service.cc:1514] Processing DeleteTablet for tablet f3aa4d0b48344693b6e37d9a18be1749 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:47 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:47308
I20260810 18:35:47.998900 22332 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37496:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:48.000348 22332 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:48.011250 22481 tablet_service.cc:1467] Processing CreateTablet for tablet 3baab78a016348409f51a41b2c3f1558 (DEFAULT_TABLE table=test-table [id=c5cf4d908ba84199b03e6075a54d3b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:48.011886 22481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3baab78a016348409f51a41b2c3f1558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.013432 22635 tablet_service.cc:1467] Processing CreateTablet for tablet 3baab78a016348409f51a41b2c3f1558 (DEFAULT_TABLE table=test-table [id=c5cf4d908ba84199b03e6075a54d3b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:48.014194 22635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3baab78a016348409f51a41b2c3f1558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.016556 22788 tablet_service.cc:1467] Processing CreateTablet for tablet 3baab78a016348409f51a41b2c3f1558 (DEFAULT_TABLE table=test-table [id=c5cf4d908ba84199b03e6075a54d3b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:48.017132 22788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3baab78a016348409f51a41b2c3f1558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.023658 22893 tablet_bootstrap.cc:492] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Bootstrap starting.
I20260810 18:35:48.025934 22893 tablet_bootstrap.cc:654] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.032796 22891 tablet_bootstrap.cc:492] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: Bootstrap starting.
I20260810 18:35:48.034979 22891 tablet_bootstrap.cc:654] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.036238 22892 tablet_bootstrap.cc:492] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Bootstrap starting.
I20260810 18:35:48.038268 22892 tablet_bootstrap.cc:654] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.041293 22892 tablet_bootstrap.cc:492] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: No bootstrap required, opened a new log
I20260810 18:35:48.041492 22892 ts_tablet_manager.cc:1397] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260810 18:35:48.042508 22892 raft_consensus.cc:348] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.042796 22892 raft_consensus.cc:374] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.042902 22892 raft_consensus.cc:729] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9a8949750b64485801d08b6414bb7b8, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.043256 22892 consensus_queue.cc:260] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.044049 22892 ts_tablet_manager.cc:1428] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 18:35:48.045776 22923 tablet_replica.cc:330] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: stopping tablet replica
I20260810 18:35:48.046412 22923 raft_consensus.cc:2229] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:48.047051 22923 raft_consensus.cc:2258] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:48.048475 22891 tablet_bootstrap.cc:492] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: No bootstrap required, opened a new log
I20260810 18:35:48.048681 22891 ts_tablet_manager.cc:1397] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.005s
I20260810 18:35:48.049788 22891 raft_consensus.cc:348] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.050079 22891 raft_consensus.cc:374] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.050199 22891 raft_consensus.cc:729] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.050590 22891 consensus_queue.cc:260] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.051218 22891 ts_tablet_manager.cc:1428] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 18:35:48.052971 22893 tablet_bootstrap.cc:492] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: No bootstrap required, opened a new log
I20260810 18:35:48.053221 22893 ts_tablet_manager.cc:1397] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.005s
I20260810 18:35:48.053732 22922 tablet_replica.cc:330] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: stopping tablet replica
I20260810 18:35:48.054320 22893 raft_consensus.cc:348] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.054610 22893 raft_consensus.cc:374] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.054630 22923 ts_tablet_manager.cc:1905] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:48.055250 22893 raft_consensus.cc:729] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3aaeef3463a42e9b5811c1bf73f3325, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.055356 22922 raft_consensus.cc:2229] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:48.055904 22922 raft_consensus.cc:2258] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:48.055948 22893 consensus_queue.cc:260] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.056798 22893 ts_tablet_manager.cc:1428] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:48.060156 22922 ts_tablet_manager.cc:1905] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:48.065937 22921 tablet_replica.cc:330] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: stopping tablet replica
I20260810 18:35:48.066490 22921 raft_consensus.cc:2229] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:48.067246 22922 ts_tablet_manager.cc:1918] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:48.067265 22921 raft_consensus.cc:2258] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:48.067399 22922 log.cc:1196] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/f3aa4d0b48344693b6e37d9a18be1749
I20260810 18:35:48.069309 22922 ts_tablet_manager.cc:1939] T f3aa4d0b48344693b6e37d9a18be1749 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting consensus metadata
I20260810 18:35:48.070737 22921 ts_tablet_manager.cc:1905] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:48.071059 22320 catalog_manager.cc:4841] TS c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281): tablet f3aa4d0b48344693b6e37d9a18be1749 (table test-table [id=858e935f1bb44a22824d7d240e138d85]) successfully deleted
I20260810 18:35:48.071668 22923 ts_tablet_manager.cc:1918] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:48.071849 22923 log.cc:1196] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/f3aa4d0b48344693b6e37d9a18be1749
I20260810 18:35:48.072324 22923 ts_tablet_manager.cc:1939] T f3aa4d0b48344693b6e37d9a18be1749 P f9a8949750b64485801d08b6414bb7b8: Deleting consensus metadata
I20260810 18:35:48.073698 22317 catalog_manager.cc:4841] TS f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571): tablet f3aa4d0b48344693b6e37d9a18be1749 (table test-table [id=858e935f1bb44a22824d7d240e138d85]) successfully deleted
I20260810 18:35:48.078155 22921 ts_tablet_manager.cc:1918] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:48.078323 22921 log.cc:1196] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/f3aa4d0b48344693b6e37d9a18be1749
I20260810 18:35:48.078845 22921 ts_tablet_manager.cc:1939] T f3aa4d0b48344693b6e37d9a18be1749 P 7352312061434c01a1b63267fcb275d8: Deleting consensus metadata
I20260810 18:35:48.080437 22317 catalog_manager.cc:4841] TS 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309): tablet f3aa4d0b48344693b6e37d9a18be1749 (table test-table [id=858e935f1bb44a22824d7d240e138d85]) successfully deleted
I20260810 18:35:48.253068 22899 raft_consensus.cc:482] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:48.253325 22899 raft_consensus.cc:504] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.254077 22899 leader_election.cc:288] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309), c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281)
I20260810 18:35:48.254806 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3baab78a016348409f51a41b2c3f1558" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" is_pre_election: true
I20260810 18:35:48.254807 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3baab78a016348409f51a41b2c3f1558" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7352312061434c01a1b63267fcb275d8" is_pre_election: true
I20260810 18:35:48.255086 22512 raft_consensus.cc:2454] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9a8949750b64485801d08b6414bb7b8 in term 0.
I20260810 18:35:48.255100 22655 raft_consensus.cc:2454] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9a8949750b64485801d08b6414bb7b8 in term 0.
I20260810 18:35:48.255548 22737 leader_election.cc:302] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3aaeef3463a42e9b5811c1bf73f3325, f9a8949750b64485801d08b6414bb7b8; no voters:
I20260810 18:35:48.255869 22899 raft_consensus.cc:2781] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:48.256009 22899 raft_consensus.cc:482] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:48.256152 22899 raft_consensus.cc:3037] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:48.258230 22899 raft_consensus.cc:504] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.258807 22899 leader_election.cc:288] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 election: Requested vote from peers 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309), c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281)
I20260810 18:35:48.259274 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3baab78a016348409f51a41b2c3f1558" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7352312061434c01a1b63267fcb275d8"
I20260810 18:35:48.259346 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3baab78a016348409f51a41b2c3f1558" candidate_uuid: "f9a8949750b64485801d08b6414bb7b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
I20260810 18:35:48.259579 22512 raft_consensus.cc:3037] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:48.259622 22655 raft_consensus.cc:3037] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:48.261845 22655 raft_consensus.cc:2454] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9a8949750b64485801d08b6414bb7b8 in term 1.
I20260810 18:35:48.262307 22737 leader_election.cc:302] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3aaeef3463a42e9b5811c1bf73f3325, f9a8949750b64485801d08b6414bb7b8; no voters:
I20260810 18:35:48.262602 22899 raft_consensus.cc:2781] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:48.263095 22512 raft_consensus.cc:2454] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9a8949750b64485801d08b6414bb7b8 in term 1.
W20260810 18:35:48.263329 22713 tablet.cc:2369] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:35:48.263113 22899 raft_consensus.cc:686] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 1 LEADER]: Becoming Leader. State: Replica: f9a8949750b64485801d08b6414bb7b8, State: Running, Role: LEADER
I20260810 18:35:48.264115 22899 consensus_queue.cc:237] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.267836 22331 catalog_manager.cc:5495] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9a8949750b64485801d08b6414bb7b8 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "f9a8949750b64485801d08b6414bb7b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } health_report { overall_health: HEALTHY } } }
W20260810 18:35:48.290083 22865 tablet.cc:2369] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 18:35:48 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386944, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.62@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:48.327296 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.310410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:38005 (local address 127.0.0.1:37498)
0810 18:35:48.311182 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:48.311204 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:48.311354 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:48.311948 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:48.311954 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:48.312892 (+ 938us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:48.313208 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.313223 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.314441 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.314447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.315976 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.315991 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.316797 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.316804 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.316996 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.317700 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:48.317737 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:48.320555 (+ 2818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:48.324622 (+ 4067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:48.324633 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:48.324640 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:48.325150 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:48.325606 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:48.325610 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:48.325613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:48.325786 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:48.326434 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:48.326440 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:48.326605 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 18:35:48.326737 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 18:35:48.326985 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":377,"threads_started":1}
I20260810 18:35:48.327668 22935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.310425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37498 (local address 127.13.139.62:38005)
0810 18:35:48.311617 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:48.311622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:48.311644 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:35:48.311690 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:48.311695 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:48.311753 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:48.311899 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:48.313394 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.314282 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.316131 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.316609 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.316711 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.320762 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:48.320769 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:48.320776 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:48.320813 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:48.324470 (+ 3657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:48.325300 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:48.325308 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:48.325313 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:48.325487 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:48.325924 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:48.325929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:48.325933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:48.326290 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:48.326455 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:48.326920 (+ 465us) server_negotiation.cc:299] Negotiation successful
0810 18:35:48.327156 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1071,"thread_start_us":916,"threads_started":1}
I20260810 18:35:48.333292 22331 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:37498:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 18:35:48.334548 22331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:48.342559 22789 tablet_service.cc:1467] Processing CreateTablet for tablet 37e6ccdde07a4f9184e5c01c9e7155c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=96164e8ee50d4dd79ff8ccf0bb44ac91]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:35:48.342505 22636 tablet_service.cc:1467] Processing CreateTablet for tablet 37e6ccdde07a4f9184e5c01c9e7155c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=96164e8ee50d4dd79ff8ccf0bb44ac91]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:35:48.343124 22789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e6ccdde07a4f9184e5c01c9e7155c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.343150 22636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e6ccdde07a4f9184e5c01c9e7155c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.346526 22482 tablet_service.cc:1467] Processing CreateTablet for tablet 37e6ccdde07a4f9184e5c01c9e7155c8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=96164e8ee50d4dd79ff8ccf0bb44ac91]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 18:35:48.347168 22482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37e6ccdde07a4f9184e5c01c9e7155c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.349293 22892 tablet_bootstrap.cc:492] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: Bootstrap starting.
I20260810 18:35:48.350514 22893 tablet_bootstrap.cc:492] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: Bootstrap starting.
I20260810 18:35:48.351040 22892 tablet_bootstrap.cc:654] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.352246 22893 tablet_bootstrap.cc:654] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.358815 22891 tablet_bootstrap.cc:492] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: Bootstrap starting.
I20260810 18:35:48.360975 22891 tablet_bootstrap.cc:654] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.361194 22892 tablet_bootstrap.cc:492] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: No bootstrap required, opened a new log
I20260810 18:35:48.361204 22893 tablet_bootstrap.cc:492] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: No bootstrap required, opened a new log
I20260810 18:35:48.361370 22893 ts_tablet_manager.cc:1397] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260810 18:35:48.361387 22892 ts_tablet_manager.cc:1397] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260810 18:35:48.362154 22892 raft_consensus.cc:348] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.362149 22893 raft_consensus.cc:348] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.362419 22892 raft_consensus.cc:374] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.362411 22893 raft_consensus.cc:374] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.362505 22892 raft_consensus.cc:729] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9a8949750b64485801d08b6414bb7b8, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.362505 22893 raft_consensus.cc:729] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3aaeef3463a42e9b5811c1bf73f3325, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.362751 22892 consensus_queue.cc:260] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.362854 22893 consensus_queue.cc:260] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.363214 22899 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.363529 22899 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:35:48.363318 22901 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.363718 22901 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:35:48.364854 22893 ts_tablet_manager.cc:1428] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:48.365876 22892 ts_tablet_manager.cc:1428] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260810 18:35:48.372221 22891 tablet_bootstrap.cc:492] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: No bootstrap required, opened a new log
I20260810 18:35:48.372411 22891 ts_tablet_manager.cc:1397] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20260810 18:35:48.373081 22891 raft_consensus.cc:348] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.373276 22891 raft_consensus.cc:374] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.373389 22891 raft_consensus.cc:729] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.373646 22891 consensus_queue.cc:260] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.374291 22891 ts_tablet_manager.cc:1428] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 18:35:48.374060 22918 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.374511 22918 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:35:48.482079 22918 raft_consensus.cc:482] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:48.482295 22918 raft_consensus.cc:504] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.482918 22918 leader_election.cc:288] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281), f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571)
I20260810 18:35:48.483549 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e6ccdde07a4f9184e5c01c9e7155c8" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" is_pre_election: true
I20260810 18:35:48.483551 22816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e6ccdde07a4f9184e5c01c9e7155c8" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8" is_pre_election: true
I20260810 18:35:48.483793 22655 raft_consensus.cc:2454] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 0.
I20260810 18:35:48.483835 22816 raft_consensus.cc:2454] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 0.
I20260810 18:35:48.484247 22434 leader_election.cc:302] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7352312061434c01a1b63267fcb275d8, c3aaeef3463a42e9b5811c1bf73f3325; no voters:
I20260810 18:35:48.484571 22918 raft_consensus.cc:2781] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:48.484701 22918 raft_consensus.cc:482] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:48.484817 22918 raft_consensus.cc:3037] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:48.486887 22918 raft_consensus.cc:504] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.487496 22918 leader_election.cc:288] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 election: Requested vote from peers c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281), f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571)
I20260810 18:35:48.487911 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e6ccdde07a4f9184e5c01c9e7155c8" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
I20260810 18:35:48.487993 22816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37e6ccdde07a4f9184e5c01c9e7155c8" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8"
I20260810 18:35:48.488145 22655 raft_consensus.cc:3037] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:48.488273 22816 raft_consensus.cc:3037] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:48.490257 22655 raft_consensus.cc:2454] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 1.
I20260810 18:35:48.490473 22816 raft_consensus.cc:2454] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 1.
I20260810 18:35:48.490674 22434 leader_election.cc:302] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7352312061434c01a1b63267fcb275d8, c3aaeef3463a42e9b5811c1bf73f3325; no voters:
I20260810 18:35:48.490978 22918 raft_consensus.cc:2781] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:48.491379 22918 raft_consensus.cc:686] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [term 1 LEADER]: Becoming Leader. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Running, Role: LEADER
I20260810 18:35:48.491701 22918 consensus_queue.cc:237] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } }
I20260810 18:35:48.493299 22940 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: TxnStatusTablet state changed. Reason: New leader 7352312061434c01a1b63267fcb275d8. Latest consensus state: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.493597 22940 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:35:48.494189 22942 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 18:35:48.494400 22942 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 18:35:48.494663 22334 catalog_manager.cc:5495] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7352312061434c01a1b63267fcb275d8 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } health_report { overall_health: HEALTHY } } }
I20260810 18:35:48.530164 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.523650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:39309 (local address 127.0.0.1:33440)
0810 18:35:48.523965 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:48.523993 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:48.524156 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:48.524830 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:48.524834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:48.524843 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:35:48.524997 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.525004 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.526698 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.526702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.527800 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.527812 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.528948 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.528953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.529109 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.529166 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:35:48.529633 (+ 467us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:35:48.529650 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 18:35:48.529717 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 18:35:48.529833 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 18:35:48.530313 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.523597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33440 (local address 127.13.139.1:39309)
0810 18:35:48.524455 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:48.524462 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:48.524490 (+ 28us) server_negotiation.cc:407] Connection header received
0810 18:35:48.524571 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:48.524577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:48.524668 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:48.524818 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:48.525132 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.526541 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.527951 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.528775 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.528911 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.529361 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:48.529526 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:48.529630 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:48.529779 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 18:35:48.529866 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":492,"threads_started":1}
I20260810 18:35:48.534750 22655 raft_consensus.cc:1261] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Refusing update from remote peer 7352312061434c01a1b63267fcb275d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:48.535003 22816 raft_consensus.cc:1261] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Refusing update from remote peer 7352312061434c01a1b63267fcb275d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:48.535594 22940 consensus_queue.cc:1035] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:48.535871 22918 consensus_queue.cc:1035] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:48.556284 22901 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: TxnStatusTablet state changed. Reason: New leader 7352312061434c01a1b63267fcb275d8. Latest consensus state: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.556587 22901 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:35:48.560786 22899 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: TxnStatusTablet state changed. Reason: New leader 7352312061434c01a1b63267fcb275d8. Latest consensus state: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.561213 22899 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:35:48.568681 22901 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.568943 22901 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P c3aaeef3463a42e9b5811c1bf73f3325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:35:48.574450 22899 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.574747 22899 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P f9a8949750b64485801d08b6414bb7b8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 18:35:48.575487 22918 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.575762 22918 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:35:48.577577 22940 tablet_replica.cc:439] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } } peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } }
I20260810 18:35:48.577883 22940 tablet_replica.cc:442] T 37e6ccdde07a4f9184e5c01c9e7155c8 P 7352312061434c01a1b63267fcb275d8: This TxnStatusTablet replica's current role is: LEADER
I20260810 18:35:48.591158 22955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.583704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47314 (local address 127.13.139.3:41571)
0810 18:35:48.584427 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:48.584435 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:48.584458 (+ 23us) server_negotiation.cc:407] Connection header received
0810 18:35:48.584561 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:48.584568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:48.584697 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:48.585042 (+ 345us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:48.585414 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.586666 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.588303 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.589058 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.589201 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.589592 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:48.590418 (+ 826us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:48.590588 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:48.590652 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 18:35:48.590747 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":445,"threads_started":1}
I20260810 18:35:48.608800 22958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.602194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:39309 (local address 127.13.139.3:46147)
0810 18:35:48.602853 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:48.602873 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:48.603073 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:48.603513 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:48.603516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:48.603526 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:35:48.603765 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.603771 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.605441 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.605445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.606625 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.606637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.607716 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.607721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.607846 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.607897 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:35:48.608335 (+ 438us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:35:48.608343 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 18:35:48.608401 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 18:35:48.608502 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":357,"threads_started":1}
I20260810 18:35:48.608832 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.602221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:46147 (local address 127.13.139.1:39309)
0810 18:35:48.602438 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:48.602445 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:48.602954 (+ 509us) server_negotiation.cc:407] Connection header received
0810 18:35:48.603227 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:48.603233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:48.603338 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:48.603476 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:48.603918 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.605274 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.606765 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.607552 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.607688 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.608077 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:48.608218 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:48.608338 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:48.608452 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 18:35:48.608545 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 18:35:48.618379 22656 raft_consensus.cc:1261] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Refusing update from remote peer f9a8949750b64485801d08b6414bb7b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:48.618954 22512 raft_consensus.cc:1261] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Refusing update from remote peer f9a8949750b64485801d08b6414bb7b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:48.619092 22928 consensus_queue.cc:1035] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:48.619652 22899 consensus_queue.cc:1035] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:48.625993 22947 mvcc.cc:205] Tried to move back new op lower bound from 7317040941534904320 to 7317040940093628416. Current Snapshot: MvccSnapshot[applied={T|T < 7317040941534904320}]
I20260810 18:35:48.659185 22955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.651848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:44731 (local address 127.13.139.3:41571)
0810 18:35:48.652033 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:48.652041 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:48.653451 (+ 1410us) server_negotiation.cc:407] Connection header received
0810 18:35:48.653651 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:48.653656 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:48.653744 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:48.653817 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:48.654490 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.655459 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.657440 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.657844 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.657980 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.658401 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:48.658495 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:48.658590 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:48.658742 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 18:35:48.658820 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 18:35:48.659276 22964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.651884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:41571 (local address 127.13.139.1:44731)
0810 18:35:48.653335 (+ 1451us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:48.653362 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:48.653515 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:48.653870 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:48.653876 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:48.653891 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:35:48.654318 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.654331 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.655586 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.655593 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.657302 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:48.657316 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.658008 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.658014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:48.658166 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.658222 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:35:48.658598 (+ 376us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:35:48.658619 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 18:35:48.658720 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 18:35:48.658860 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1049,"thread_start_us":825,"threads_started":1}
I20260810 18:35:48.697888 22334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:48.698179 22334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37496:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:48.702024 22334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Sending DeleteTablet for 3 replicas of tablet 3baab78a016348409f51a41b2c3f1558
I20260810 18:35:48.703047 22636 tablet_service.cc:1514] Processing DeleteTablet for tablet 3baab78a016348409f51a41b2c3f1558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:48 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 18:35:48.703099 22482 tablet_service.cc:1514] Processing DeleteTablet for tablet 3baab78a016348409f51a41b2c3f1558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:48 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:33424
I20260810 18:35:48.703688 22789 tablet_service.cc:1514] Processing DeleteTablet for tablet 3baab78a016348409f51a41b2c3f1558 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:48 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:47308
I20260810 18:35:48.728261 22970 tablet_replica.cc:330] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: stopping tablet replica
I20260810 18:35:48.728533 22970 raft_consensus.cc:2229] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:48.729377 22970 raft_consensus.cc:2258] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:48.729966 22968 tablet_replica.cc:330] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: stopping tablet replica
I20260810 18:35:48.731222 22970 ts_tablet_manager.cc:1905] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:48.735673 22968 raft_consensus.cc:2229] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:48.735986 22968 raft_consensus.cc:2258] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:48.737795 22969 tablet_replica.cc:330] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: stopping tablet replica
I20260810 18:35:48.738018 22969 raft_consensus.cc:2229] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:48.738296 22969 raft_consensus.cc:2258] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:48.738523 22968 ts_tablet_manager.cc:1905] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:48.740562 22969 ts_tablet_manager.cc:1905] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:48.748463 22969 ts_tablet_manager.cc:1918] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:48.748608 22969 log.cc:1196] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/3baab78a016348409f51a41b2c3f1558
I20260810 18:35:48.749100 22969 ts_tablet_manager.cc:1939] T 3baab78a016348409f51a41b2c3f1558 P 7352312061434c01a1b63267fcb275d8: Deleting consensus metadata
I20260810 18:35:48.750347 22317 catalog_manager.cc:4841] TS 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309): tablet 3baab78a016348409f51a41b2c3f1558 (table test-table [id=c5cf4d908ba84199b03e6075a54d3b7d]) successfully deleted
I20260810 18:35:48.755146 22968 ts_tablet_manager.cc:1918] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:48.758236 22970 ts_tablet_manager.cc:1918] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:48.758495 22970 log.cc:1196] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/3baab78a016348409f51a41b2c3f1558
I20260810 18:35:48.759085 22970 ts_tablet_manager.cc:1939] T 3baab78a016348409f51a41b2c3f1558 P f9a8949750b64485801d08b6414bb7b8: Deleting consensus metadata
I20260810 18:35:48.759543 22968 log.cc:1196] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/3baab78a016348409f51a41b2c3f1558
I20260810 18:35:48.760135 22968 ts_tablet_manager.cc:1939] T 3baab78a016348409f51a41b2c3f1558 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting consensus metadata
I20260810 18:35:48.761425 22317 catalog_manager.cc:4841] TS f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571): tablet 3baab78a016348409f51a41b2c3f1558 (table test-table [id=c5cf4d908ba84199b03e6075a54d3b7d]) successfully deleted
I20260810 18:35:48.762379 22320 catalog_manager.cc:4841] TS c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281): tablet 3baab78a016348409f51a41b2c3f1558 (table test-table [id=c5cf4d908ba84199b03e6075a54d3b7d]) successfully deleted
Aug 10 18:35:48 dist-test-slave-5k54 krb5kdc[22287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 18:35:48 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:48 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
W20260810 18:35:48.851140 22978 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:48.831463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37504 (local address 127.13.139.62:38005)
0810 18:35:48.832470 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:48.832477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:48.832498 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:35:48.832565 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:48.832571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:48.832670 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:48.832800 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:48.834669 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.836046 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.838014 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.838793 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.838947 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.850722 (+ 11775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37504: BlockingRecv error: recv got EOF from 127.0.0.1:37504 (error 108)
Metrics: {"server-negotiator.queue_time_us":873,"thread_start_us":757,"threads_started":1}
Aug 10 18:35:48 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM
I20260810 18:35:48.883939 22978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:48.850598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37520 (local address 127.13.139.62:38005)
0810 18:35:48.852070 (+ 1472us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:48.852080 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:48.861997 (+ 9917us) server_negotiation.cc:407] Connection header received
0810 18:35:48.862490 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:48.862496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:48.862588 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:48.862670 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:48.864607 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.865936 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.868836 (+ 2900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:48.869571 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:48.869716 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:48.875931 (+ 6215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:48.875939 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:48.875945 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:48.875994 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:48.880184 (+ 4190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:48.881160 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:48.881167 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:48.881172 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:48.881385 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:48.881894 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:48.881901 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:48.881904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:48.882312 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:48.882588 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:48.883180 (+ 592us) server_negotiation.cc:299] Negotiation successful
0810 18:35:48.883496 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1302,"thread_start_us":17036,"threads_started":1}
I20260810 18:35:48.889873 22334 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37520:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:48.890714 22334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:48.899520 22482 tablet_service.cc:1467] Processing CreateTablet for tablet 1918d34926034a6ba89e8f015044742d (DEFAULT_TABLE table=test-table [id=24f9601834734df98d4f35aaf12f02b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:48.899910 22789 tablet_service.cc:1467] Processing CreateTablet for tablet 1918d34926034a6ba89e8f015044742d (DEFAULT_TABLE table=test-table [id=24f9601834734df98d4f35aaf12f02b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:48.900094 22482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1918d34926034a6ba89e8f015044742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.900372 22789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1918d34926034a6ba89e8f015044742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.911929 22636 tablet_service.cc:1467] Processing CreateTablet for tablet 1918d34926034a6ba89e8f015044742d (DEFAULT_TABLE table=test-table [id=24f9601834734df98d4f35aaf12f02b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:48.912544 22636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1918d34926034a6ba89e8f015044742d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:48.924074 22986 tablet_bootstrap.cc:492] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: Bootstrap starting.
I20260810 18:35:48.926416 22986 tablet_bootstrap.cc:654] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.927893 22987 tablet_bootstrap.cc:492] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: Bootstrap starting.
I20260810 18:35:48.930094 22987 tablet_bootstrap.cc:654] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.931676 22989 tablet_bootstrap.cc:492] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: Bootstrap starting.
I20260810 18:35:48.933352 22989 tablet_bootstrap.cc:654] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:48.937173 22986 tablet_bootstrap.cc:492] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: No bootstrap required, opened a new log
I20260810 18:35:48.937361 22986 ts_tablet_manager.cc:1397] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260810 18:35:48.937641 22989 tablet_bootstrap.cc:492] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: No bootstrap required, opened a new log
I20260810 18:35:48.937894 22989 ts_tablet_manager.cc:1397] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 18:35:48.938378 22986 raft_consensus.cc:348] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.938678 22986 raft_consensus.cc:374] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.938812 22986 raft_consensus.cc:729] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.939064 22989 raft_consensus.cc:348] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.939440 22989 raft_consensus.cc:374] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.940299 22987 tablet_bootstrap.cc:492] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: No bootstrap required, opened a new log
I20260810 18:35:48.940531 22987 ts_tablet_manager.cc:1397] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260810 18:35:48.941344 22986 consensus_queue.cc:260] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.941769 22989 raft_consensus.cc:729] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9a8949750b64485801d08b6414bb7b8, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.942101 22989 consensus_queue.cc:260] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.941445 22987 raft_consensus.cc:348] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.942576 22987 raft_consensus.cc:374] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:48.942729 22987 raft_consensus.cc:729] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3aaeef3463a42e9b5811c1bf73f3325, State: Initialized, Role: FOLLOWER
I20260810 18:35:48.944027 22989 ts_tablet_manager.cc:1428] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260810 18:35:48.944272 22987 consensus_queue.cc:260] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:48.944965 22987 ts_tablet_manager.cc:1428] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 18:35:48.948925 22986 ts_tablet_manager.cc:1428] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260810 18:35:49.103783 22901 raft_consensus.cc:482] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:49.104043 22901 raft_consensus.cc:504] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.105523 22901 leader_election.cc:288] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309), f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571)
I20260810 18:35:49.113735 22955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.107059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:34623 (local address 127.13.139.3:41571)
0810 18:35:49.107294 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.107302 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.107399 (+ 97us) server_negotiation.cc:407] Connection header received
0810 18:35:49.107724 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.107730 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.107873 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.107997 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:49.108544 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.109594 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.111874 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.112754 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.112937 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.113019 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.113286 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.113426 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:35:49.113838 22995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.106745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:41571 (local address 127.13.139.2:34623)
0810 18:35:49.107308 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:49.107325 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:49.107557 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:49.108019 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:49.108023 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:49.108052 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:49.108348 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:49.108360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.109765 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.109771 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:49.111740 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:49.111754 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.112938 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.112952 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:49.113121 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.113144 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:35:49.113250 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 18:35:49.113377 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"spinlock_wait_cycles":3456,"thread_start_us":572,"threads_started":1}
I20260810 18:35:49.114625 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.105963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:43555 (local address 127.13.139.1:39309)
0810 18:35:49.106144 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.106149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.106632 (+ 483us) server_negotiation.cc:407] Connection header received
0810 18:35:49.106863 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.106869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.107013 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.107122 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:35:49.107894 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.109110 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.111828 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.113248 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.113456 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.113549 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.114204 (+ 655us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.114360 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:35:49.114712 22994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.105860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:39309 (local address 127.13.139.2:43555)
0810 18:35:49.106514 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:49.106531 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:49.106698 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:49.107313 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:49.107320 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:49.107352 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:35:49.107743 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:49.107753 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.109367 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.109372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:49.111629 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:49.111650 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.113731 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.113741 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:49.113966 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.114003 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 18:35:49.114170 (+ 167us) client_negotiation.cc:240] Negotiation successful
0810 18:35:49.114337 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":410,"threads_started":1}
I20260810 18:35:49.114727 22811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1918d34926034a6ba89e8f015044742d" candidate_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8" is_pre_election: true
I20260810 18:35:49.115065 22811 raft_consensus.cc:2454] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3aaeef3463a42e9b5811c1bf73f3325 in term 0.
I20260810 18:35:49.115477 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1918d34926034a6ba89e8f015044742d" candidate_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7352312061434c01a1b63267fcb275d8" is_pre_election: true
I20260810 18:35:49.115743 22512 raft_consensus.cc:2454] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3aaeef3463a42e9b5811c1bf73f3325 in term 0.
I20260810 18:35:49.115686 22584 leader_election.cc:302] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3aaeef3463a42e9b5811c1bf73f3325, f9a8949750b64485801d08b6414bb7b8; no voters:
I20260810 18:35:49.116202 22901 raft_consensus.cc:2781] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:49.116371 22901 raft_consensus.cc:482] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:49.116494 22901 raft_consensus.cc:3037] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:49.120091 22901 raft_consensus.cc:504] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.120836 22901 leader_election.cc:288] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [CANDIDATE]: Term 1 election: Requested vote from peers 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309), f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571)
I20260810 18:35:49.121310 22512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1918d34926034a6ba89e8f015044742d" candidate_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7352312061434c01a1b63267fcb275d8"
I20260810 18:35:49.121407 22811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1918d34926034a6ba89e8f015044742d" candidate_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8"
I20260810 18:35:49.121585 22512 raft_consensus.cc:3037] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:49.121637 22811 raft_consensus.cc:3037] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:49.124297 22811 raft_consensus.cc:2454] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3aaeef3463a42e9b5811c1bf73f3325 in term 1.
I20260810 18:35:49.124732 22584 leader_election.cc:302] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3aaeef3463a42e9b5811c1bf73f3325, f9a8949750b64485801d08b6414bb7b8; no voters:
I20260810 18:35:49.124961 22512 raft_consensus.cc:2454] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3aaeef3463a42e9b5811c1bf73f3325 in term 1.
I20260810 18:35:49.125104 22901 raft_consensus.cc:2781] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:49.125695 22901 raft_consensus.cc:686] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 LEADER]: Becoming Leader. State: Replica: c3aaeef3463a42e9b5811c1bf73f3325, State: Running, Role: LEADER
I20260810 18:35:49.126133 22901 consensus_queue.cc:237] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.129904 22334 catalog_manager.cc:5495] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2). New cstate: current_term: 1 leader_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } health_report { overall_health: UNKNOWN } } }
I20260810 18:35:49.174016 22999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.162248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58792 (local address 127.13.139.2:42281)
0810 18:35:49.167170 (+ 4922us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.167180 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.167211 (+ 31us) server_negotiation.cc:407] Connection header received
0810 18:35:49.167386 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.167392 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.167547 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.167796 (+ 249us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:49.168301 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.169650 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.170987 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.171793 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.171954 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.172395 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:49.173252 (+ 857us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:49.173437 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.173511 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.173610 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4770,"thread_start_us":4581,"threads_started":1}
I20260810 18:35:49.178292 22512 raft_consensus.cc:1261] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Refusing update from remote peer c3aaeef3463a42e9b5811c1bf73f3325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:49.178471 22811 raft_consensus.cc:1261] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Refusing update from remote peer c3aaeef3463a42e9b5811c1bf73f3325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:49.179142 22996 consensus_queue.cc:1035] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:49.179553 22901 consensus_queue.cc:1035] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:49.200634 22334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:49.200959 22334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:49.205621 22334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Sending DeleteTablet for 3 replicas of tablet 1918d34926034a6ba89e8f015044742d
I20260810 18:35:49.207587 22482 tablet_service.cc:1514] Processing DeleteTablet for tablet 1918d34926034a6ba89e8f015044742d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:49 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:33424
I20260810 18:35:49.207980 22789 tablet_service.cc:1514] Processing DeleteTablet for tablet 1918d34926034a6ba89e8f015044742d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:49 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:47308
I20260810 18:35:49.208335 22969 tablet_replica.cc:330] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: stopping tablet replica
I20260810 18:35:49.208781 22970 tablet_replica.cc:330] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: stopping tablet replica
I20260810 18:35:49.209035 22970 raft_consensus.cc:2229] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:49.209328 22970 raft_consensus.cc:2258] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:49.210546 22636 tablet_service.cc:1514] Processing DeleteTablet for tablet 1918d34926034a6ba89e8f015044742d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:49 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 18:35:49.210881 22968 tablet_replica.cc:330] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: stopping tablet replica
I20260810 18:35:49.211108 22968 raft_consensus.cc:2229] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:49.211752 22968 raft_consensus.cc:2258] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:49.212575 22969 raft_consensus.cc:2229] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:49.213169 22969 raft_consensus.cc:2258] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:49.213497 22331 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37520:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:35:49.214322 22331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:35:49.215050 22968 ts_tablet_manager.cc:1905] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:49.215050 22969 ts_tablet_manager.cc:1905] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:49.222029 22968 ts_tablet_manager.cc:1918] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:49.223047 22970 ts_tablet_manager.cc:1905] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:49.223063 22969 ts_tablet_manager.cc:1918] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:49.223219 22969 log.cc:1196] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/1918d34926034a6ba89e8f015044742d
I20260810 18:35:49.223728 22969 ts_tablet_manager.cc:1939] T 1918d34926034a6ba89e8f015044742d P 7352312061434c01a1b63267fcb275d8: Deleting consensus metadata
I20260810 18:35:49.224491 22789 tablet_service.cc:1467] Processing CreateTablet for tablet 160168cb7dee42d391268e06f1cd7390 (DEFAULT_TABLE table=test-table [id=b2603c0d170d4361b0fcc50575f6839f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:49.224889 22317 catalog_manager.cc:4841] TS 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309): tablet 1918d34926034a6ba89e8f015044742d (table test-table [id=24f9601834734df98d4f35aaf12f02b0]) successfully deleted
I20260810 18:35:49.225039 22789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160168cb7dee42d391268e06f1cd7390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:49.229784 22968 log.cc:1196] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/1918d34926034a6ba89e8f015044742d
I20260810 18:35:49.229753 22482 tablet_service.cc:1467] Processing CreateTablet for tablet 160168cb7dee42d391268e06f1cd7390 (DEFAULT_TABLE table=test-table [id=b2603c0d170d4361b0fcc50575f6839f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:49.230268 22482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160168cb7dee42d391268e06f1cd7390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:49.230305 22968 ts_tablet_manager.cc:1939] T 1918d34926034a6ba89e8f015044742d P c3aaeef3463a42e9b5811c1bf73f3325: Deleting consensus metadata
I20260810 18:35:49.232273 22320 catalog_manager.cc:4841] TS c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281): tablet 1918d34926034a6ba89e8f015044742d (table test-table [id=24f9601834734df98d4f35aaf12f02b0]) successfully deleted
I20260810 18:35:49.232862 22636 tablet_service.cc:1467] Processing CreateTablet for tablet 160168cb7dee42d391268e06f1cd7390 (DEFAULT_TABLE table=test-table [id=b2603c0d170d4361b0fcc50575f6839f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:35:49.233337 22636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 160168cb7dee42d391268e06f1cd7390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:49.236730 22986 tablet_bootstrap.cc:492] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: Bootstrap starting.
I20260810 18:35:49.238507 22986 tablet_bootstrap.cc:654] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:49.238547 22970 ts_tablet_manager.cc:1918] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:35:49.239339 22989 tablet_bootstrap.cc:492] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: Bootstrap starting.
I20260810 18:35:49.241379 22970 log.cc:1196] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/1918d34926034a6ba89e8f015044742d
I20260810 18:35:49.241901 22970 ts_tablet_manager.cc:1939] T 1918d34926034a6ba89e8f015044742d P f9a8949750b64485801d08b6414bb7b8: Deleting consensus metadata
I20260810 18:35:49.244295 22989 tablet_bootstrap.cc:654] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:49.247117 22987 tablet_bootstrap.cc:492] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: Bootstrap starting.
I20260810 18:35:49.249205 22987 tablet_bootstrap.cc:654] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:49.249996 22986 tablet_bootstrap.cc:492] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: No bootstrap required, opened a new log
I20260810 18:35:49.250224 22986 ts_tablet_manager.cc:1397] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.010s
I20260810 18:35:49.250214 22317 catalog_manager.cc:4841] TS f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571): tablet 1918d34926034a6ba89e8f015044742d (table test-table [id=24f9601834734df98d4f35aaf12f02b0]) successfully deleted
I20260810 18:35:49.251154 22986 raft_consensus.cc:348] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.251375 22989 tablet_bootstrap.cc:492] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: No bootstrap required, opened a new log
I20260810 18:35:49.251502 22986 raft_consensus.cc:374] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:49.251602 22986 raft_consensus.cc:729] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Initialized, Role: FOLLOWER
I20260810 18:35:49.251670 22989 ts_tablet_manager.cc:1397] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260810 18:35:49.251935 22986 consensus_queue.cc:260] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.252604 22986 ts_tablet_manager.cc:1428] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 18:35:49.253608 22989 raft_consensus.cc:348] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.254074 22989 raft_consensus.cc:374] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:49.254225 22989 raft_consensus.cc:729] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9a8949750b64485801d08b6414bb7b8, State: Initialized, Role: FOLLOWER
I20260810 18:35:49.254594 22989 consensus_queue.cc:260] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.255311 22989 ts_tablet_manager.cc:1428] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:49.257709 22987 tablet_bootstrap.cc:492] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: No bootstrap required, opened a new log
I20260810 18:35:49.257902 22987 ts_tablet_manager.cc:1397] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260810 18:35:49.260147 22987 raft_consensus.cc:348] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.260406 22987 raft_consensus.cc:374] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:49.260516 22987 raft_consensus.cc:729] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3aaeef3463a42e9b5811c1bf73f3325, State: Initialized, Role: FOLLOWER
I20260810 18:35:49.260756 22987 consensus_queue.cc:260] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.261423 22987 ts_tablet_manager.cc:1428] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:49.308450 22959 raft_consensus.cc:482] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:35:49.308688 22959 raft_consensus.cc:504] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.309476 22959 leader_election.cc:288] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281), f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571)
I20260810 18:35:49.310036 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160168cb7dee42d391268e06f1cd7390" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" is_pre_election: true
I20260810 18:35:49.310288 22655 raft_consensus.cc:2454] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 0.
I20260810 18:35:49.310257 22811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160168cb7dee42d391268e06f1cd7390" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8" is_pre_election: true
I20260810 18:35:49.310532 22811 raft_consensus.cc:2454] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 0.
I20260810 18:35:49.310879 22434 leader_election.cc:302] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7352312061434c01a1b63267fcb275d8, c3aaeef3463a42e9b5811c1bf73f3325; no voters:
I20260810 18:35:49.311194 22959 raft_consensus.cc:2781] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:35:49.311342 22959 raft_consensus.cc:482] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:35:49.311470 22959 raft_consensus.cc:3037] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:49.314714 22959 raft_consensus.cc:504] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.315860 22655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160168cb7dee42d391268e06f1cd7390" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3aaeef3463a42e9b5811c1bf73f3325"
I20260810 18:35:49.315969 22811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "160168cb7dee42d391268e06f1cd7390" candidate_uuid: "7352312061434c01a1b63267fcb275d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9a8949750b64485801d08b6414bb7b8"
I20260810 18:35:49.316063 22655 raft_consensus.cc:3037] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:49.316179 22811 raft_consensus.cc:3037] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:49.319375 22655 raft_consensus.cc:2454] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 1.
I20260810 18:35:49.319536 22811 raft_consensus.cc:2454] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7352312061434c01a1b63267fcb275d8 in term 1.
I20260810 18:35:49.319892 22434 leader_election.cc:302] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7352312061434c01a1b63267fcb275d8, c3aaeef3463a42e9b5811c1bf73f3325; no voters:
I20260810 18:35:49.320180 22959 leader_election.cc:288] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [CANDIDATE]: Term 1 election: Requested vote from peers c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281), f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571)
I20260810 18:35:49.320407 22959 raft_consensus.cc:2781] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:49.320552 22959 raft_consensus.cc:686] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 1 LEADER]: Becoming Leader. State: Replica: 7352312061434c01a1b63267fcb275d8, State: Running, Role: LEADER
I20260810 18:35:49.320873 22959 consensus_queue.cc:237] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } }
I20260810 18:35:49.331223 22334 catalog_manager.cc:5495] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7352312061434c01a1b63267fcb275d8 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "7352312061434c01a1b63267fcb275d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7352312061434c01a1b63267fcb275d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 39309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 } health_report { overall_health: UNKNOWN } } }
I20260810 18:35:49.362516 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.356584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33448 (local address 127.13.139.1:39309)
0810 18:35:49.356778 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.356784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.357120 (+ 336us) server_negotiation.cc:407] Connection header received
0810 18:35:49.357311 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.357314 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.357380 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.357466 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:49.357915 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.358633 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.360842 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.361229 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.361323 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.361830 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:49.361949 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:49.362014 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.362187 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.362251 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 18:35:49.376075 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.371135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:37501 (local address 127.13.139.1:39309)
0810 18:35:49.371345 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.371352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.371648 (+ 296us) server_negotiation.cc:407] Connection header received
0810 18:35:49.371831 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.371835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.371899 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.371996 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:35:49.372405 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.373100 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.374362 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.374770 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.374905 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.375249 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:35:49.375339 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:35:49.375434 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.375622 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.375705 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":67}
I20260810 18:35:49.376101 23014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.370945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:39309 (local address 127.13.139.1:37501)
0810 18:35:49.371558 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:49.371573 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:49.371720 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:49.372006 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:49.372011 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:49.372021 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 18:35:49.372258 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:49.372266 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.373225 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.373232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:49.374218 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:49.374229 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.374925 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.374931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:49.375059 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.375091 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 18:35:49.375466 (+ 375us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 18:35:49.375478 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 18:35:49.375597 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 18:35:49.375779 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":313,"threads_started":1}
I20260810 18:35:49.385885 22655 raft_consensus.cc:1261] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Refusing update from remote peer 7352312061434c01a1b63267fcb275d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:49.386458 22811 raft_consensus.cc:1261] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Refusing update from remote peer 7352312061434c01a1b63267fcb275d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:35:49.386420 22959 consensus_queue.cc:1035] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3aaeef3463a42e9b5811c1bf73f3325" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:49.387029 22959 consensus_queue.cc:1035] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9a8949750b64485801d08b6414bb7b8" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:35:49.443249 22334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:49.443539 22334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37520:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:35:49.446688 22334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a89f600efcc43cd9890ef7c4dc4141f: Sending DeleteTablet for 3 replicas of tablet 160168cb7dee42d391268e06f1cd7390
I20260810 18:35:49.447458 22482 tablet_service.cc:1514] Processing DeleteTablet for tablet 160168cb7dee42d391268e06f1cd7390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:49 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:33424
I20260810 18:35:49.447696 22636 tablet_service.cc:1514] Processing DeleteTablet for tablet 160168cb7dee42d391268e06f1cd7390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:49 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 18:35:49.447778 22969 tablet_replica.cc:330] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: stopping tablet replica
I20260810 18:35:49.447999 22968 tablet_replica.cc:330] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: stopping tablet replica
I20260810 18:35:49.447964 22969 raft_consensus.cc:2229] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:35:49.447971 22789 tablet_service.cc:1514] Processing DeleteTablet for tablet 160168cb7dee42d391268e06f1cd7390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:35:49 UTC) from {username='oryx', principal='oryx/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:47308
I20260810 18:35:49.448171 22968 raft_consensus.cc:2229] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:49.448261 22970 tablet_replica.cc:330] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: stopping tablet replica
I20260810 18:35:49.448344 22969 raft_consensus.cc:2258] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:49.448371 22968 raft_consensus.cc:2258] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:49.448467 22970 raft_consensus.cc:2229] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:35:49.448689 22970 raft_consensus.cc:2258] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:35:49.449635 22968 ts_tablet_manager.cc:1905] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:49.450591 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 22415
I20260810 18:35:49.459393 22969 ts_tablet_manager.cc:1905] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:49.459707 22970 ts_tablet_manager.cc:1905] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:35:49.470027 22969 ts_tablet_manager.cc:1918] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:49.470207 22969 log.cc:1196] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/160168cb7dee42d391268e06f1cd7390
I20260810 18:35:49.470804 22969 ts_tablet_manager.cc:1939] T 160168cb7dee42d391268e06f1cd7390 P 7352312061434c01a1b63267fcb275d8: Deleting consensus metadata
I20260810 18:35:49.472407 22317 catalog_manager.cc:4841] TS 7352312061434c01a1b63267fcb275d8 (127.13.139.1:39309): tablet 160168cb7dee42d391268e06f1cd7390 (table test-table [id=b2603c0d170d4361b0fcc50575f6839f]) successfully deleted
I20260810 18:35:49.472956 22968 ts_tablet_manager.cc:1918] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:49.473145 22968 log.cc:1196] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/160168cb7dee42d391268e06f1cd7390
I20260810 18:35:49.473726 22968 ts_tablet_manager.cc:1939] T 160168cb7dee42d391268e06f1cd7390 P c3aaeef3463a42e9b5811c1bf73f3325: Deleting consensus metadata
I20260810 18:35:49.474045 22970 ts_tablet_manager.cc:1918] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 18:35:49.474206 22970 log.cc:1196] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/160168cb7dee42d391268e06f1cd7390
I20260810 18:35:49.474633 22970 ts_tablet_manager.cc:1939] T 160168cb7dee42d391268e06f1cd7390 P f9a8949750b64485801d08b6414bb7b8: Deleting consensus metadata
I20260810 18:35:49.475154 22320 catalog_manager.cc:4841] TS c3aaeef3463a42e9b5811c1bf73f3325 (127.13.139.2:42281): tablet 160168cb7dee42d391268e06f1cd7390 (table test-table [id=b2603c0d170d4361b0fcc50575f6839f]) successfully deleted
I20260810 18:35:49.475745 22317 catalog_manager.cc:4841] TS f9a8949750b64485801d08b6414bb7b8 (127.13.139.3:41571): tablet 160168cb7dee42d391268e06f1cd7390 (table test-table [id=b2603c0d170d4361b0fcc50575f6839f]) successfully deleted
Aug 10 18:35:49 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.1@KRBTEST.COM
I20260810 18:35:49.495313 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.455596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33456 (local address 127.13.139.1:39309)
0810 18:35:49.455823 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.455830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.476848 (+ 21018us) server_negotiation.cc:407] Connection header received
0810 18:35:49.477051 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.477057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.477146 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.477265 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:49.478999 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.480112 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.481950 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.482649 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.482793 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.488051 (+ 5258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:49.488070 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:49.488089 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:49.488132 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:49.492190 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:49.493031 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:49.493042 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:49.493046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:49.493214 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:49.493608 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:49.493613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:49.493617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:49.494081 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:49.494405 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.494703 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.494928 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 18:35:49.496069 22558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:49.657464 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 22415
I20260810 18:35:49.688138 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 22567
Aug 10 18:35:49 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.2@KRBTEST.COM
I20260810 18:35:49.705704 23020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.689008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58804 (local address 127.13.139.2:42281)
0810 18:35:49.689658 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.689662 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.689677 (+ 15us) server_negotiation.cc:407] Connection header received
0810 18:35:49.689732 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.689736 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.689793 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.689927 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:49.691204 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.692183 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.693464 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.693988 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.694136 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.698982 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:49.699001 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:49.699016 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:49.699051 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:49.702390 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:49.703316 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:49.703323 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:49.703325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:49.703657 (+ 332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:49.704109 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:49.704113 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:49.704115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:49.704575 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:49.704810 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.705259 (+ 449us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.705443 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":344,"threads_started":1}
I20260810 18:35:49.706476 22706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:49.844796 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 22567
I20260810 18:35:49.870715 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 22717
Aug 10 18:35:49 dist-test-slave-5k54 krb5kdc[22287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.139.3@KRBTEST.COM
I20260810 18:35:49.886243 23024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:49.871548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47330 (local address 127.13.139.3:41571)
0810 18:35:49.872071 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:49.872076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:49.872092 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:35:49.872147 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:49.872151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:49.872207 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:49.872298 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:49.873594 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.874328 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.875592 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:49.876147 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:49.876257 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:49.880785 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:49.880803 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:49.880821 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:49.880867 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:49.883755 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:49.884392 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:49.884399 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:49.884401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:49.884552 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:49.884984 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:49.884987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:49.884989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:49.885305 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:49.885545 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:49.885807 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 18:35:49.885978 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":301,"threads_started":1}
I20260810 18:35:49.886957 22859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:50.011714 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 22717
I20260810 18:35:50.036314 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 22301
I20260810 18:35:50.037642 22381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:50.155318 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 22301
2026-08-10T18:35:50Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7217 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:50 dist-test-slave-5k54 krb5kdc[23029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:50 dist-test-slave-5k54 krb5kdc[23029](info): set up 2 sockets
Aug 10 18:35:50 dist-test-slave-5k54 krb5kdc[23029](info): commencing operation
krb5kdc: starting...
W20260810 18:35:51.354681 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:51 dist-test-slave-5k54 krb5kdc[23029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:51.614881 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43019
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:43019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:51.945529 23046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:51.945840 23046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:51.946041 23046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:51.953137 23046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:51.953244 23046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:51.953356 23046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:51.953454 23046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:51.953550 23046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:51.963251 23046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:43019
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:51.964601 23046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:51.965981 23046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:51.978186 23053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:51.978225 23055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:51.978259 23051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:51.979178 23046 server_base.cc:1034] running on GCE node
I20260810 18:35:51.980049 23046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:51.981400 23046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:51.982604 23046 hybrid_clock.cc:648] HybridClock initialized: now 1786386951982545 us; error 48 us; skew 500 ppm
I20260810 18:35:51.982985 23046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T18:35:52Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1896 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:35:52 dist-test-slave-5k54 krb5kdc[23062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:35:52 dist-test-slave-5k54 krb5kdc[23062](info): set up 2 sockets
Aug 10 18:35:52 dist-test-slave-5k54 krb5kdc[23062](info): commencing operation
krb5kdc: starting...
W20260810 18:35:53.239886 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:35:53 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:35:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:35:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:35:53.503687 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:41507
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:41507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:53.837333 23077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:53.837656 23077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:53.837853 23077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:53.845425 23077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:53.845562 23077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:53.845651 23077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:53.845757 23077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:53.845839 23077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:53.856133 23077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:41507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:41507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:53.857523 23077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:53.858860 23077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:53.871558 23084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:53.871579 23083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:53.871767 23087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:53.872222 23077 server_base.cc:1034] running on GCE node
I20260810 18:35:53.873232 23077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:53.874707 23077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:53.875964 23077 hybrid_clock.cc:648] HybridClock initialized: now 1786386953875909 us; error 62 us; skew 500 ppm
I20260810 18:35:53.876379 23077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:53 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386953, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:53.879911 23077 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:53.881421 23077 webserver.cc:460] Webserver started at http://127.13.139.62:41803/ using document root <none> and password file <none>
I20260810 18:35:53.882304 23077 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:53.882455 23077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:53.882794 23077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:53.886126 23077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "ac778cdbc39d43b8be8f025909b9fdac"
format_stamp: "Formatted at 2026-08-10 18:35:53 on dist-test-slave-5k54"
server_key: "fa917e8dac83419a7ec5a4e961b69394"
server_key_iv: "f609268124666a01334c8f603a8920d9"
server_key_version: "encryptionkey@0"
I20260810 18:35:53.887058 23077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "ac778cdbc39d43b8be8f025909b9fdac"
format_stamp: "Formatted at 2026-08-10 18:35:53 on dist-test-slave-5k54"
server_key: "fa917e8dac83419a7ec5a4e961b69394"
server_key_iv: "f609268124666a01334c8f603a8920d9"
server_key_version: "encryptionkey@0"
I20260810 18:35:53.892563 23077 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260810 18:35:53.896150 23094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:53.897521 23077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:35:53.897706 23077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "ac778cdbc39d43b8be8f025909b9fdac"
format_stamp: "Formatted at 2026-08-10 18:35:53 on dist-test-slave-5k54"
server_key: "fa917e8dac83419a7ec5a4e961b69394"
server_key_iv: "f609268124666a01334c8f603a8920d9"
server_key_version: "encryptionkey@0"
I20260810 18:35:53.897909 23077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:53.912393 23077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:53.916863 23077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:53.917162 23077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:53.936373 23077 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:41507
I20260810 18:35:53.936393 23148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:41507 every 8 connection(s)
I20260810 18:35:53.937929 23077 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:53.939682 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 23077
I20260810 18:35:53.939922 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:35:53.940768 13868 external_mini_cluster.cc:1428] Setting key d0bb54a786a96bb054ef8ec34b9cb9be
I20260810 18:35:53.942672 23149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:35:53.953933 23149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Bootstrap starting.
Aug 10 18:35:53 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:53.957257 23149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Neither blocks nor log segments found. Creating new log.
I20260810 18:35:53.958338 23149 log.cc:824] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:53.961303 23149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: No bootstrap required, opened a new log
I20260810 18:35:53.962924 23152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:53.942916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51734 (local address 127.13.139.62:41507)
0810 18:35:53.943762 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:53.943773 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:53.943819 (+ 46us) server_negotiation.cc:407] Connection header received
0810 18:35:53.945491 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:53.945512 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:53.945899 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:53.946316 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:53.947887 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:53.949196 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:53.950508 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:53.951216 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:53.951461 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:53.955588 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:53.955602 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:53.955616 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:53.955651 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:53.958814 (+ 3163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:53.959567 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:53.959573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:53.959579 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:53.959738 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:53.960151 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:53.960155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:53.960157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:53.960659 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:53.960988 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:53.961454 (+ 466us) server_negotiation.cc:299] Negotiation successful
0810 18:35:53.961903 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":370,"threads_started":1}
I20260810 18:35:53.970556 23149 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:53.970953 23149 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:35:53.971074 23149 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac778cdbc39d43b8be8f025909b9fdac, State: Initialized, Role: FOLLOWER
I20260810 18:35:53.971722 23149 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:53.971974 23149 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:53.972126 23149 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:53.972318 23149 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:35:53.974956 23149 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:53.975564 23149 leader_election.cc:302] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac778cdbc39d43b8be8f025909b9fdac; no voters:
I20260810 18:35:53.976147 23149 leader_election.cc:288] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:35:53.976282 23154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:35:53.977027 23154 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 LEADER]: Becoming Leader. State: Replica: ac778cdbc39d43b8be8f025909b9fdac, State: Running, Role: LEADER
I20260810 18:35:53.977530 23154 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:53.978217 23149 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:53.980756 23156 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac778cdbc39d43b8be8f025909b9fdac. Latest consensus state: current_term: 1 leader_uuid: "ac778cdbc39d43b8be8f025909b9fdac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } } }
I20260810 18:35:53.981243 23156 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:53.984506 23163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:53.984459 23155 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac778cdbc39d43b8be8f025909b9fdac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } } }
I20260810 18:35:53.984846 23155 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:53.989745 23163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:53.997743 23163 catalog_manager.cc:1347] Generated new cluster ID: 0e6a6ecf65c9481194f577f03833ef64
I20260810 18:35:53.997892 23163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:54.012476 23163 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:35:54.014410 23163 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:54.027405 23163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Generated new TSK 0
I20260810 18:35:54.028527 23163 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:35:54.091255 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:41507
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:54.427058 23177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:54.427322 23177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:54.427462 23177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:54.434681 23177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:54.434795 23177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:54.434908 23177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:54.444643 23177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:41507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:54.445973 23177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:54.447252 23177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:54.460336 23183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:54.460270 23188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:54.460304 23184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:54.461622 23177 server_base.cc:1034] running on GCE node
I20260810 18:35:54.462383 23177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:54.463557 23177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:54.464754 23177 hybrid_clock.cc:648] HybridClock initialized: now 1786386954464718 us; error 31 us; skew 500 ppm
I20260810 18:35:54.465087 23177 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:54 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386954, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:54.468348 23177 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:35:54.469846 23177 webserver.cc:460] Webserver started at http://127.13.139.1:35289/ using document root <none> and password file <none>
I20260810 18:35:54.470556 23177 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:54.470701 23177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:54.471015 23177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:54.473982 23177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "b8e7411fc86f4a9691eb4e6b8ac0d436"
format_stamp: "Formatted at 2026-08-10 18:35:54 on dist-test-slave-5k54"
server_key: "21cfd5bdc15917b922a44c1c1ce58ebf"
server_key_iv: "1d24a4bce3d6aef94479ba6068af4152"
server_key_version: "encryptionkey@0"
I20260810 18:35:54.474815 23177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "b8e7411fc86f4a9691eb4e6b8ac0d436"
format_stamp: "Formatted at 2026-08-10 18:35:54 on dist-test-slave-5k54"
server_key: "21cfd5bdc15917b922a44c1c1ce58ebf"
server_key_iv: "1d24a4bce3d6aef94479ba6068af4152"
server_key_version: "encryptionkey@0"
I20260810 18:35:54.480162 23177 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260810 18:35:54.483590 23196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:54.485034 23177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:35:54.485206 23177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "b8e7411fc86f4a9691eb4e6b8ac0d436"
format_stamp: "Formatted at 2026-08-10 18:35:54 on dist-test-slave-5k54"
server_key: "21cfd5bdc15917b922a44c1c1ce58ebf"
server_key_iv: "1d24a4bce3d6aef94479ba6068af4152"
server_key_version: "encryptionkey@0"
I20260810 18:35:54.485392 23177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:54.521011 23177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:54.525584 23177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:54.525887 23177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:54.527019 23177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:54.529124 23177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:54.529222 23177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:54.529362 23177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:54.529433 23177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:54.563853 23177 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:38635
I20260810 18:35:54.563956 23323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:38635 every 8 connection(s)
I20260810 18:35:54.565171 23177 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:54.567800 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 23177
I20260810 18:35:54.568043 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:35:54.568883 13868 external_mini_cluster.cc:1428] Setting key 0be5ff97eb733d93088e663636cfa495
Aug 10 18:35:54 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386954, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:54.588019 23326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:54.567860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:35149 (local address 127.13.139.62:41507)
0810 18:35:54.568329 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:54.568336 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:54.569541 (+ 1205us) server_negotiation.cc:407] Connection header received
0810 18:35:54.571985 (+ 2444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:54.571989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:54.572054 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:54.572144 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:54.574264 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:54.574984 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:54.577414 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:54.577814 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:54.577966 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:54.582166 (+ 4200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:54.582171 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:54.582174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:54.582207 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:54.584869 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:54.585597 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:54.585609 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:54.585612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:54.585727 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:54.586214 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:54.586217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:54.586219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:54.586487 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:54.586663 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:54.587400 (+ 737us) server_negotiation.cc:299] Negotiation successful
0810 18:35:54.587657 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":234,"threads_started":1}
I20260810 18:35:54.589109 23327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:54.568586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:35149)
0810 18:35:54.569373 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:54.569417 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:54.571677 (+ 2260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:54.572423 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:54.572437 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:54.573264 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:54.574089 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:54.574118 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:54.575139 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:54.575147 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:54.577263 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:54.577280 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:54.578053 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:54.578063 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:54.578452 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:54.579235 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:54.579275 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:54.581932 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:54.585017 (+ 3085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:54.585026 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:54.585042 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:54.585467 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:54.585839 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:54.585844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:54.585848 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:54.586042 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:54.586620 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:54.586627 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:54.586970 (+ 343us) client_negotiation.cc:769] Sending connection context
0810 18:35:54.587263 (+ 293us) client_negotiation.cc:240] Negotiation successful
0810 18:35:54.587810 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":342,"threads_started":1}
I20260810 18:35:54.590662 23324 heartbeater.cc:347] Connected to a master server at 127.13.139.62:41507
I20260810 18:35:54.590996 23324 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:54.591958 23324 heartbeater.cc:511] Master 127.13.139.62:41507 requested a full tablet report, sending...
I20260810 18:35:54.594296 23112 ts_manager.cc:194] Registered new tserver with Master: b8e7411fc86f4a9691eb4e6b8ac0d436 (127.13.139.1:38635)
I20260810 18:35:54.595811 23112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:35149
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:35:54.630071 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:41507
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:54.964025 23331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:54.964287 23331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:54.964458 23331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:54.971757 23331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:54.971886 23331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:54.972070 23331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:54.981911 23331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:41507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:54.983191 23331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:54.984562 23331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:54.998082 23340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:54.998018 23336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:54.998056 23337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:54.998965 23331 server_base.cc:1034] running on GCE node
I20260810 18:35:54.999727 23331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:55.000697 23331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:55.001986 23331 hybrid_clock.cc:648] HybridClock initialized: now 1786386955001911 us; error 59 us; skew 500 ppm
I20260810 18:35:55.002308 23331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:54 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386954, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:55.005643 23331 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:35:55.007157 23331 webserver.cc:460] Webserver started at http://127.13.139.2:38851/ using document root <none> and password file <none>
I20260810 18:35:55.007948 23331 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:55.008080 23331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:55.008391 23331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:55.011235 23331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "97d3de7542c0412f8723a0a5df5ff4c8"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "63291048d3e733861471a4e76a751dcb"
server_key_iv: "fc70637539e4b8537bcb0e107d3f7a89"
server_key_version: "encryptionkey@0"
I20260810 18:35:55.012127 23331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "97d3de7542c0412f8723a0a5df5ff4c8"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "63291048d3e733861471a4e76a751dcb"
server_key_iv: "fc70637539e4b8537bcb0e107d3f7a89"
server_key_version: "encryptionkey@0"
I20260810 18:35:55.017128 23331 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:35:55.020527 23347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:55.021804 23331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:35:55.022006 23331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "97d3de7542c0412f8723a0a5df5ff4c8"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "63291048d3e733861471a4e76a751dcb"
server_key_iv: "fc70637539e4b8537bcb0e107d3f7a89"
server_key_version: "encryptionkey@0"
I20260810 18:35:55.022248 23331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:55.037065 23331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:55.041308 23331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:55.041602 23331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:55.042522 23331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:55.043884 23331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:55.043984 23331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:55.044134 23331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:55.044211 23331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:55.077461 23331 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:34407
I20260810 18:35:55.077503 23468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:34407 every 8 connection(s)
I20260810 18:35:55.078868 23331 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:55.085992 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 23331
I20260810 18:35:55.086179 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:35:55.086666 13868 external_mini_cluster.cc:1428] Setting key 49033a62f9cd19ac3e5b8ecd405f37e1
Aug 10 18:35:55 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386954, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:55.100613 23326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:55.081478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:46617 (local address 127.13.139.62:41507)
0810 18:35:55.081656 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:55.081661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:55.082851 (+ 1190us) server_negotiation.cc:407] Connection header received
0810 18:35:55.084869 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:55.084873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:55.084944 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:55.085031 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:55.086679 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.087628 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.089535 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.090143 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.090288 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:55.094387 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:55.094392 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:55.094395 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:55.094427 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:55.097099 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.097819 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.097831 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.097833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.097964 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.098707 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.098712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.098717 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.099011 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:55.099176 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:55.100035 (+ 859us) server_negotiation.cc:299] Negotiation successful
0810 18:35:55.100275 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:35:55.101785 23471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:55.081997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:46617)
0810 18:35:55.082685 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:55.082731 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:55.084573 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:55.085279 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:55.085287 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:55.085804 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:55.086507 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:55.086526 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.087793 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.087797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:55.089385 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:55.089397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.090383 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.090394 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:55.090737 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:55.091505 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:55.091540 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:55.094164 (+ 2624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:55.097252 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:55.097260 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:55.097277 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:55.097687 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:55.098322 (+ 635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:55.098353 (+ 31us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:55.098358 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:55.098574 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:55.099146 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:55.099154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:55.099587 (+ 433us) client_negotiation.cc:769] Sending connection context
0810 18:35:55.099868 (+ 281us) client_negotiation.cc:240] Negotiation successful
0810 18:35:55.100429 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":263,"threads_started":1}
I20260810 18:35:55.103377 23469 heartbeater.cc:347] Connected to a master server at 127.13.139.62:41507
I20260810 18:35:55.103767 23469 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:55.104528 23469 heartbeater.cc:511] Master 127.13.139.62:41507 requested a full tablet report, sending...
I20260810 18:35:55.106070 23112 ts_manager.cc:194] Registered new tserver with Master: 97d3de7542c0412f8723a0a5df5ff4c8 (127.13.139.2:34407)
I20260810 18:35:55.106992 23112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:46617
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:35:55.148674 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:41507
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:55.480894 23474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:55.481185 23474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:55.481336 23474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:55.489575 23474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:55.489709 23474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:55.489909 23474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:55.499768 23474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:41507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:55.501098 23474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:55.502481 23474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:55.515872 23479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:55.515918 23480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:55.515959 23482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:55.517114 23474 server_base.cc:1034] running on GCE node
I20260810 18:35:55.517745 23474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:55.518698 23474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:55.519950 23474 hybrid_clock.cc:648] HybridClock initialized: now 1786386955519896 us; error 57 us; skew 500 ppm
I20260810 18:35:55.520308 23474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:55 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386955, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:55.523597 23474 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:35:55.525030 23474 webserver.cc:460] Webserver started at http://127.13.139.3:33153/ using document root <none> and password file <none>
I20260810 18:35:55.525767 23474 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:55.525898 23474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:55.526233 23474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:35:55.529239 23474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "fc91e5359b134f0f9a2d21b05fbc4c97"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "e3fc933b1854c3af4be5e512293df813"
server_key_iv: "af4edebbe5bdc7b0515b3cd75c10b0d8"
server_key_version: "encryptionkey@0"
I20260810 18:35:55.530037 23474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "fc91e5359b134f0f9a2d21b05fbc4c97"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "e3fc933b1854c3af4be5e512293df813"
server_key_iv: "af4edebbe5bdc7b0515b3cd75c10b0d8"
server_key_version: "encryptionkey@0"
I20260810 18:35:55.536459 23474 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260810 18:35:55.539934 23490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:55.541250 23474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:35:55.541441 23474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "fc91e5359b134f0f9a2d21b05fbc4c97"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "e3fc933b1854c3af4be5e512293df813"
server_key_iv: "af4edebbe5bdc7b0515b3cd75c10b0d8"
server_key_version: "encryptionkey@0"
I20260810 18:35:55.541638 23474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:55.557653 23474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:55.561486 23474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:55.561771 23474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:55.562731 23474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:55.564440 23474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:55.564543 23474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:55.564673 23474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:55.564746 23474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:55.599007 23324 heartbeater.cc:503] Master 127.13.139.62:41507 was elected leader, sending a full tablet report...
I20260810 18:35:55.599907 23474 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:40257
I20260810 18:35:55.599920 23624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:40257 every 8 connection(s)
I20260810 18:35:55.601534 23474 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:55.603634 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 23474
I20260810 18:35:55.603838 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:35:55.604480 13868 external_mini_cluster.cc:1428] Setting key c9d6b911327ee98561cfcf380317d239
Aug 10 18:35:55 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386955, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:35:55.622287 23627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:55.604417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:51217 (local address 127.13.139.62:41507)
0810 18:35:55.604959 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:55.604963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:55.606150 (+ 1187us) server_negotiation.cc:407] Connection header received
0810 18:35:55.608437 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:55.608442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:55.608525 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:55.608646 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:55.610107 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.610909 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.612480 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.612890 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.613026 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:55.616456 (+ 3430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:55.616461 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:55.616465 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:55.616497 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:55.619371 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.620309 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.620313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.620315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.620439 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.620812 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.620816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.620818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.621085 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:55.621201 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:55.621818 (+ 617us) server_negotiation.cc:299] Negotiation successful
0810 18:35:55.622002 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":334,"threads_started":1}
I20260810 18:35:55.623248 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:55.605140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:51217)
0810 18:35:55.605968 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:55.606034 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:55.608176 (+ 2142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:55.608897 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:55.608905 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:55.609399 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:55.609943 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:55.609961 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.611064 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.611075 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:55.612335 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:55.612347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.613113 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.613121 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:55.613353 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:55.613989 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:55.614011 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:55.616263 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:35:55.619571 (+ 3308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:55.619578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:55.619589 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:55.620190 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:55.620533 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:35:55.620536 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:35:55.620538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:35:55.620716 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:35:55.621193 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:35:55.621198 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:35:55.621496 (+ 298us) client_negotiation.cc:769] Sending connection context
0810 18:35:55.621720 (+ 224us) client_negotiation.cc:240] Negotiation successful
0810 18:35:55.622096 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":310,"threads_started":1}
I20260810 18:35:55.624648 23625 heartbeater.cc:347] Connected to a master server at 127.13.139.62:41507
I20260810 18:35:55.624975 23625 heartbeater.cc:464] Registering TS with master...
I20260810 18:35:55.625761 23625 heartbeater.cc:511] Master 127.13.139.62:41507 requested a full tablet report, sending...
I20260810 18:35:55.627202 23112 ts_manager.cc:194] Registered new tserver with Master: fc91e5359b134f0f9a2d21b05fbc4c97 (127.13.139.3:40257)
I20260810 18:35:55.628055 23112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:51217
I20260810 18:35:55.632275 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab.
Entry for principal oryx/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab.
WARNING: no policy specified for oryx/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab.
Entry for principal oryx/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab.
WARNING: no policy specified for oryx/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab.
Entry for principal oryx/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab.
I20260810 18:35:55.797785 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23177
Aug 10 18:35:55 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:35:55.815120 23640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:55.799078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44374 (local address 127.13.139.1:38635)
0810 18:35:55.799804 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:55.799812 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:55.799839 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:35:55.799902 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:55.799908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:55.800133 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:55.800276 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:55.801987 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.803141 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.804590 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.805176 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.805278 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:55.809841 (+ 4563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:55.809852 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:55.809866 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:55.809899 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:55.812765 (+ 2866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.813414 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.813422 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.813424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.813561 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.813898 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.813901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.813903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.814220 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:55.814470 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:55.814648 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 18:35:55.814838 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":419,"threads_started":1}
I20260810 18:35:55.816444 23317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:55.899333 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 23177
I20260810 18:35:55.918217 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23331
Aug 10 18:35:55 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:35:55.934875 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:55.919134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40366 (local address 127.13.139.2:34407)
0810 18:35:55.919706 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:55.919713 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:55.919738 (+ 25us) server_negotiation.cc:407] Connection header received
0810 18:35:55.919796 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:55.919802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:55.920015 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:55.920181 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:55.921444 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.922444 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.924048 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:55.924680 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:55.924835 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:55.929264 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:55.929275 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:55.929288 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:55.929321 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:55.932058 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.932766 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.932774 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.932776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.932893 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:55.933274 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:55.933281 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:55.933287 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:55.933634 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:55.933967 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:55.934233 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 18:35:55.934505 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":323,"threads_started":1}
I20260810 18:35:55.936280 23463 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:56.022326 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 23331
I20260810 18:35:56.040858 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23474
Aug 10 18:35:56 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:35:56.057561 23647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:56.041781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.13.139.3:40257)
0810 18:35:56.042369 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:56.042376 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:56.042405 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:35:56.042469 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:56.042475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:56.042686 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:56.042812 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:56.044181 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:56.045200 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:56.046651 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:56.047210 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:56.047311 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:56.051687 (+ 4376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:56.051698 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:56.051712 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:56.051746 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:56.054615 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:56.055298 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:56.055304 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:56.055307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:56.055587 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:56.055965 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:56.055969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:56.055973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:56.056309 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:56.056616 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:56.056910 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 18:35:56.057208 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":301,"threads_started":1}
I20260810 18:35:56.058844 23619 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:56.142829 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 23474
I20260810 18:35:56.162163 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23077
I20260810 18:35:56.163391 23144 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:35:56.268303 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 23077
I20260810 18:35:56.291349 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:41507
--webserver_interface=127.13.139.62
--webserver_port=41803
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:41507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:35:56.628715 23650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:56.629061 23650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:56.629243 23650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:56.636507 23650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:35:56.636663 23650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:56.636768 23650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:56.636922 23650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:35:56.637005 23650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:35:56.646698 23650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:41507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:41507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=41803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:56.648047 23650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:56.649380 23650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:56.661137 23658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:56.661211 23661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:56.661109 23659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:56.661878 23650 server_base.cc:1034] running on GCE node
I20260810 18:35:56.662658 23650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:56.664129 23650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:56.665372 23650 hybrid_clock.cc:648] HybridClock initialized: now 1786386956665321 us; error 64 us; skew 500 ppm
I20260810 18:35:56.665730 23650 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:56 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386956, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:56.668900 23650 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:35:56.670337 23650 webserver.cc:460] Webserver started at http://127.13.139.62:41803/ using document root <none> and password file <none>
I20260810 18:35:56.671046 23650 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:56.671206 23650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:56.676795 23650 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260810 18:35:56.679869 23668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:56.681192 23650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:35:56.681388 23650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "ac778cdbc39d43b8be8f025909b9fdac"
format_stamp: "Formatted at 2026-08-10 18:35:53 on dist-test-slave-5k54"
server_key: "fa917e8dac83419a7ec5a4e961b69394"
server_key_iv: "f609268124666a01334c8f603a8920d9"
server_key_version: "encryptionkey@0"
I20260810 18:35:56.682402 23650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:56.711997 23650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:56.715992 23650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:56.716282 23650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:56.735280 23650 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:41507
I20260810 18:35:56.735438 23724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:41507 every 8 connection(s)
I20260810 18:35:56.736984 23650 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:35:56.738394 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 23650
I20260810 18:35:56.739509 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:38635
--local_ip_for_outbound_sockets=127.13.139.1
--tserver_master_addrs=127.13.139.62:41507
--webserver_port=35289
--webserver_interface=127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:35:56.747527 23726 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:35:56.752265 23726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Bootstrap starting.
I20260810 18:35:56.772625 23726 log.cc:824] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Log is configured to *not* fsync() on all Append() calls
I20260810 18:35:56.782074 23726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:35:56.782709 23726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Bootstrap complete.
I20260810 18:35:56.792984 23726 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:56.793919 23726 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac778cdbc39d43b8be8f025909b9fdac, State: Initialized, Role: FOLLOWER
I20260810 18:35:56.794704 23726 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:56.794962 23726 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:35:56.795094 23726 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:35:56.795303 23726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 1 FOLLOWER]: Advancing to term 2
I20260810 18:35:56.799496 23726 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:56.800115 23726 leader_election.cc:302] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac778cdbc39d43b8be8f025909b9fdac; no voters:
I20260810 18:35:56.800814 23726 leader_election.cc:288] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 18:35:56.800971 23730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 2 FOLLOWER]: Leader election won for term 2
I20260810 18:35:56.802120 23730 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [term 2 LEADER]: Becoming Leader. State: Replica: ac778cdbc39d43b8be8f025909b9fdac, State: Running, Role: LEADER
I20260810 18:35:56.802803 23730 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } }
I20260810 18:35:56.803153 23726 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:35:56.805518 23732 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac778cdbc39d43b8be8f025909b9fdac. Latest consensus state: current_term: 2 leader_uuid: "ac778cdbc39d43b8be8f025909b9fdac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } } }
I20260810 18:35:56.805866 23732 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:56.806305 23731 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ac778cdbc39d43b8be8f025909b9fdac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac778cdbc39d43b8be8f025909b9fdac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41507 } } }
I20260810 18:35:56.806674 23731 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac [sys.catalog]: This master's current role is: LEADER
I20260810 18:35:56.806855 23736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:35:56.826050 23736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:35:56.827661 23736 catalog_manager.cc:1259] Loaded cluster ID: 0e6a6ecf65c9481194f577f03833ef64
I20260810 18:35:56.827780 23736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:35:56.832388 23736 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:35:56.834184 23736 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ac778cdbc39d43b8be8f025909b9fdac: Loaded TSK: 0
I20260810 18:35:56.836155 23736 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 18:35:57.097370 23728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:57.097692 23728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:57.097860 23728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:57.105453 23728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:57.105621 23728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:57.105794 23728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:35:57.115836 23728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.1.keytab
--principal=oryx/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:38635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=35289
--tserver_master_addrs=127.13.139.62:41507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:57.117249 23728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:57.118561 23728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:57.136063 23754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:57.136261 23758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:57.136261 23755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:57.137961 23728 server_base.cc:1034] running on GCE node
I20260810 18:35:57.138661 23728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:57.139792 23728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:57.141047 23728 hybrid_clock.cc:648] HybridClock initialized: now 1786386957140977 us; error 62 us; skew 500 ppm
I20260810 18:35:57.141398 23728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:57 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386957, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:57.145191 23728 init.cc:377] Logged in from keytab as oryx/127.13.139.1@KRBTEST.COM (short username oryx)
I20260810 18:35:57.146694 23728 webserver.cc:460] Webserver started at http://127.13.139.1:35289/ using document root <none> and password file <none>
I20260810 18:35:57.147405 23728 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:57.147614 23728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:57.153519 23728 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260810 18:35:57.156375 23765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:57.157714 23728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:35:57.157894 23728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "b8e7411fc86f4a9691eb4e6b8ac0d436"
format_stamp: "Formatted at 2026-08-10 18:35:54 on dist-test-slave-5k54"
server_key: "21cfd5bdc15917b922a44c1c1ce58ebf"
server_key_iv: "1d24a4bce3d6aef94479ba6068af4152"
server_key_version: "encryptionkey@0"
I20260810 18:35:57.158898 23728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:57.174670 23728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:57.178723 23728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:57.179041 23728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:57.180068 23728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:57.181309 23728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:57.181416 23728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:57.181501 23728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:57.181558 23728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:57.215189 23728 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:38635
I20260810 18:35:57.215286 23895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:38635 every 8 connection(s)
I20260810 18:35:57.216667 23728 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:35:57.219702 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 23728
I20260810 18:35:57.220525 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:34407
--local_ip_for_outbound_sockets=127.13.139.2
--tserver_master_addrs=127.13.139.62:41507
--webserver_port=38851
--webserver_interface=127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:35:57 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:57 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
W20260810 18:35:57.561565 23901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:57.561875 23901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:57.562064 23901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:57.569263 23901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:57.569363 23901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:57.569578 23901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:35:57.578879 23901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.2.keytab
--principal=oryx/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:34407
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=38851
--tserver_master_addrs=127.13.139.62:41507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:57.580263 23901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:57.581617 23901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:57.600216 23909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:57.600315 23908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:57.601154 23911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:57.601696 23901 server_base.cc:1034] running on GCE node
I20260810 18:35:57.602289 23901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:57.603513 23901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:57.604946 23901 hybrid_clock.cc:648] HybridClock initialized: now 1786386957604868 us; error 83 us; skew 500 ppm
I20260810 18:35:57.605271 23901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:57 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386957, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:57.609764 23901 init.cc:377] Logged in from keytab as oryx/127.13.139.2@KRBTEST.COM (short username oryx)
I20260810 18:35:57.612370 23901 webserver.cc:460] Webserver started at http://127.13.139.2:38851/ using document root <none> and password file <none>
I20260810 18:35:57.613691 23901 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:57.613921 23901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:57.624357 23901 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.008s sys 0.000s
I20260810 18:35:57.628916 23918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:57.630348 23901 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260810 18:35:57.630530 23901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "97d3de7542c0412f8723a0a5df5ff4c8"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "63291048d3e733861471a4e76a751dcb"
server_key_iv: "fc70637539e4b8537bcb0e107d3f7a89"
server_key_version: "encryptionkey@0"
I20260810 18:35:57.631700 23901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:57.654541 23901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:57.659202 23901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:57.659579 23901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:57.660808 23901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:57.662631 23901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:57.662825 23901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:57.662966 23901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:57.663064 23901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:57.711948 23901 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:34407
I20260810 18:35:57.712016 24047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:34407 every 8 connection(s)
I20260810 18:35:57.713557 23901 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:35:57.722699 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 23901
I20260810 18:35:57.723825 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:40257
--local_ip_for_outbound_sockets=127.13.139.3
--tserver_master_addrs=127.13.139.62:41507
--webserver_port=33153
--webserver_interface=127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:35:57 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:57 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
W20260810 18:35:58.212594 24053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:35:58.212917 24053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:35:58.213106 24053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:35:58.224412 24053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:35:58.224562 24053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:35:58.224757 24053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:35:58.235039 24053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/krb5kdc/oryx_127.13.139.3.keytab
--principal=oryx/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:40257
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=33153
--tserver_master_addrs=127.13.139.62:41507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:35:58.236529 24053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:35:58.237828 24053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:35:58.255101 24059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:58.259377 24060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:35:58.260221 24063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:35:58.261291 24053 server_base.cc:1034] running on GCE node
I20260810 18:35:58.262068 24053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:35:58.263769 24053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:35:58.264983 24053 hybrid_clock.cc:648] HybridClock initialized: now 1786386958264915 us; error 55 us; skew 500 ppm
I20260810 18:35:58.265319 24053 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:35:58 dist-test-slave-5k54 krb5kdc[23062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386958, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:35:58.271402 24053 init.cc:377] Logged in from keytab as oryx/127.13.139.3@KRBTEST.COM (short username oryx)
I20260810 18:35:58.273278 24053 webserver.cc:460] Webserver started at http://127.13.139.3:33153/ using document root <none> and password file <none>
I20260810 18:35:58.274024 24053 fs_manager.cc:359] Metadata directory not provided
I20260810 18:35:58.274192 24053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:35:58.279829 24053 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 18:35:58.282567 24069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:58.284056 24053 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:35:58.284237 24053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "fc91e5359b134f0f9a2d21b05fbc4c97"
format_stamp: "Formatted at 2026-08-10 18:35:55 on dist-test-slave-5k54"
server_key: "e3fc933b1854c3af4be5e512293df813"
server_key_iv: "af4edebbe5bdc7b0515b3cd75c10b0d8"
server_key_version: "encryptionkey@0"
I20260810 18:35:58.285274 24053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:35:58.298583 24053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:35:58.302897 24053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:35:58.303228 24053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:35:58.304512 24053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:35:58.306018 24053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:35:58.306139 24053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:58.306267 24053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:35:58.306370 24053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:35:58.352486 24053 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:40257
I20260810 18:35:58.352530 24191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:40257 every 8 connection(s)
I20260810 18:35:58.353976 24053 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:35:58.356594 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 24053
Aug 10 18:35:58 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:58.398689 24197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:58.358018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.13.139.62:41507)
0810 18:35:58.369644 (+ 11626us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:58.369653 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:58.369680 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:35:58.369763 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:58.369771 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:58.369886 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:58.370023 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:58.373079 (+ 3056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.374737 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.376773 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.377792 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.377973 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:58.382736 (+ 4763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:35:58.382752 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:35:58.382779 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:35:58.382843 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:35:58.389199 (+ 6356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:58.390593 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:58.390606 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:58.390620 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:58.390947 (+ 327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:35:58.392195 (+ 1248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:35:58.392203 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:35:58.392210 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:35:58.393125 (+ 915us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:35:58.393630 (+ 505us) server_negotiation.cc:1035] Waiting for connection context
0810 18:35:58.396417 (+ 2787us) server_negotiation.cc:299] Negotiation successful
0810 18:35:58.397141 (+ 724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11465,"thread_start_us":20074,"threads_started":1}
Aug 10 18:35:58 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
W20260810 18:35:58.670205 23900 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.437s user 0.000s sys 0.018s
W20260810 18:35:58.672498 23899 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:57.219756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:50535 (local address 127.13.139.62:41507)
0810 18:35:57.220551 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:57.220567 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:57.221373 (+ 806us) server_negotiation.cc:407] Connection header received
0810 18:35:57.224557 (+ 3184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:57.224570 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:57.224935 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:57.225225 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:57.227209 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.228477 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.230972 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.232220 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.232428 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:58.672021 (+1439593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:50535: BlockingRecv error: recv got EOF from 127.13.139.1:50535 (error 108)
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":279,"threads_started":1}
I20260810 18:35:58.674197 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:57.219760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:50535)
0810 18:35:57.221176 (+ 1416us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:57.221229 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:57.223972 (+ 2743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:57.225452 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:57.225466 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:57.226240 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:57.227006 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:57.227033 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.228650 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.228658 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:57.230789 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:57.230807 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.232465 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.232471 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:57.232714 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:57.233497 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:57.233524 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:58.671517 (+1437993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1106,"thread_start_us":899,"threads_started":1}
W20260810 18:35:58.676033 23897 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:41507 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.139.62:41507: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Aug 10 18:35:58 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:58 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:58.685978 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:58.676758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:37473)
0810 18:35:58.677030 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:58.677049 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:58.677173 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:58.677518 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:58.677522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:58.677912 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:58.678075 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:58.678084 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.679121 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.679126 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:58.680159 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:58.680171 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.680904 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.680909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:58.681082 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:58.681715 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:58.681733 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:58.685639 (+ 3906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144}
W20260810 18:35:58.686160 23899 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:58.676908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:37473 (local address 127.13.139.62:41507)
0810 18:35:58.677075 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:58.677082 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:58.677101 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:35:58.677301 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:58.677307 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:58.677378 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:58.677485 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:58.678220 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.678969 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.680310 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.680706 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.680849 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:58.685827 (+ 4978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:37473: BlockingRecv error: recv got EOF from 127.13.139.1:37473 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 18:35:58 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:58 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:58.701943 23900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:58.686898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:50857)
0810 18:35:58.692936 (+ 6038us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:58.692952 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:58.693078 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:58.693702 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:58.693705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:58.693997 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:58.694143 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:58.694150 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.695275 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.695280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:58.696342 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:58.696354 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.697109 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.697116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:58.697298 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:58.697901 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:58.697918 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:58.701620 (+ 3702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":5963,"thread_start_us":6262,"threads_started":1}
W20260810 18:35:58.702124 23899 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:58.687246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:50857 (local address 127.13.139.62:41507)
0810 18:35:58.687497 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:58.687506 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:58.693029 (+ 5523us) server_negotiation.cc:407] Connection header received
0810 18:35:58.693424 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:58.693434 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:58.693493 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:58.693546 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:58.694291 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.695099 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.696485 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.696947 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.697078 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:58.701862 (+ 4784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:50857: BlockingRecv error: recv got EOF from 127.13.139.1:50857 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 18:35:58.702562 23897 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 18:35:59.095685 24051 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.368s user 0.007s sys 0.011s
I20260810 18:35:59.097415 24051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:57.717258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:51205)
0810 18:35:57.718128 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:57.718185 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:57.720162 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:57.721271 (+ 1109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:57.721279 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:57.721856 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:57.722438 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:57.722456 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.723784 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.723790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:57.725289 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:57.725302 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.726186 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.726197 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:57.726449 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:57.727187 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:57.727216 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:59.096536 (+1369320us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":373,"threads_started":1}
W20260810 18:35:59.097396 24050 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:57.716690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:51205 (local address 127.13.139.62:41507)
0810 18:35:57.717311 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:57.717322 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:57.718311 (+ 989us) server_negotiation.cc:407] Connection header received
0810 18:35:57.720808 (+ 2497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:57.720816 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:57.720908 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:57.721091 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:57.722636 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.723616 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.725456 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:57.725917 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:57.726064 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.096919 (+1370855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:51205: BlockingRecv error: recv got EOF from 127.13.139.2:51205 (error 108)
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":269,"threads_started":1}
W20260810 18:35:59.098685 24048 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:41507 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.139.62:41507: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:59.111688 24051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:59.099569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:48675)
0810 18:35:59.099852 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:59.099882 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:59.100051 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:59.100417 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:59.100425 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:59.101102 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:59.101421 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.101438 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.102726 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.102734 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.105177 (+ 2443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.105200 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.106148 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.106155 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.106344 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.107110 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:59.107128 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:59.111350 (+ 4222us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84}
W20260810 18:35:59.111831 24050 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:59.099656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:48675 (local address 127.13.139.62:41507)
0810 18:35:59.099825 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:59.099830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:59.099970 (+ 140us) server_negotiation.cc:407] Connection header received
0810 18:35:59.100184 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:59.100188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:59.100250 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:59.100330 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:59.101753 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.102561 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.105363 (+ 2802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.105958 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.106107 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.111569 (+ 5462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:48675: BlockingRecv error: recv got EOF from 127.13.139.2:48675 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:59.122078 24051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:59.112722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:55913)
0810 18:35:59.112891 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:59.112908 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:59.113035 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:59.113566 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:59.113571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:59.113874 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:59.114017 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.114024 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.115013 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.115020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.116021 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.116032 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.116834 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.116840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.117021 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.117727 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:59.117743 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:59.121800 (+ 4057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":58}
W20260810 18:35:59.122251 24050 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:59.113115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:55913 (local address 127.13.139.62:41507)
0810 18:35:59.113318 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:59.113323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:59.113338 (+ 15us) server_negotiation.cc:407] Connection header received
0810 18:35:59.113375 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:59.113378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:59.113430 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:59.113532 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:59.114163 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.114866 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.116168 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.116678 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.116808 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.122005 (+ 5197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:55913: BlockingRecv error: recv got EOF from 127.13.139.2:55913 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 18:35:59.123034 24048 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 18:35:59.586480 24196 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.192s user 0.008s sys 0.018s
W20260810 18:35:59.587858 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:58.365973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:37279 (local address 127.13.139.62:41507)
0810 18:35:58.378104 (+ 12131us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:58.378110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:58.378132 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:35:58.380089 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:58.380098 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:58.380205 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:58.380339 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:58.383628 (+ 3289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.385534 (+ 1906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.389189 (+ 3655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.390171 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.390305 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.587595 (+1197290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:37279: BlockingRecv error: recv got EOF from 127.13.139.3:37279 (error 108)
Metrics: {"server-negotiator.queue_time_us":11986,"thread_start_us":3385,"threads_started":1}
I20260810 18:35:59.588553 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:58.365328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:37279)
0810 18:35:58.376169 (+ 10841us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:58.376250 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:58.379512 (+ 3262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:58.381050 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:58.381068 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:58.382153 (+ 1085us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:58.383281 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:58.383313 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.385849 (+ 2536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.385857 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:58.388929 (+ 3072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:58.388954 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:58.390804 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:58.390814 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:58.391290 (+ 476us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:58.393885 (+ 2595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:58.393932 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:59.587388 (+1193456us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":10409,"thread_start_us":10135,"threads_started":1}
W20260810 18:35:59.589442 24192 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:41507 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.139.62:41507: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:59.598716 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:59.590213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:40343)
0810 18:35:59.590423 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:59.590441 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:59.590565 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:59.590897 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:59.590902 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:59.591291 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:59.591525 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.591535 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.592571 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.592577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.593535 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.593546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.594262 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.594269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.594432 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.594993 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:59.595010 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:59.598435 (+ 3425us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":70}
W20260810 18:35:59.598871 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:59.590286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:40343 (local address 127.13.139.62:41507)
0810 18:35:59.590471 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:59.590480 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:59.590501 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:35:59.590692 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:59.590696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:59.590759 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:59.590869 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:59.591664 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.592418 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.593688 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.594089 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.594231 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.598638 (+ 4407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:40343: BlockingRecv error: recv got EOF from 127.13.139.3:40343 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:59.607600 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:59.599516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:39165)
0810 18:35:59.599663 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:59.599685 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:59.599794 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:59.600160 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:59.600167 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:59.600469 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:59.600614 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.600622 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.601593 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.601598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.602630 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.602646 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.603448 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.603455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.603671 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.604283 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:59.604306 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:59.607315 (+ 3009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 18:35:59.607800 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:59.599621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:39165 (local address 127.13.139.62:41507)
0810 18:35:59.599905 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:59.599912 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:59.599938 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:35:59.599974 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:59.599977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:59.600026 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:59.600126 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:59.600749 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.601455 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.602774 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.603281 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.603442 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.607544 (+ 4102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:39165: BlockingRecv error: recv got EOF from 127.13.139.3:39165 (error 108)
Metrics: {"server-negotiator.queue_time_us":133}
W20260810 18:35:59.607895 24192 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:35:59 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:35:59.712883 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:35:59.703125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:51603)
0810 18:35:59.703762 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0810 18:35:59.703778 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:35:59.703940 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:35:59.704301 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:35:59.704306 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:35:59.704867 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:35:59.705023 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.705032 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.706035 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.706041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.707188 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:35:59.707201 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.708065 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.708072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:35:59.708243 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.708887 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:35:59.708906 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:35:59.712561 (+ 3655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":415,"threads_started":1}
W20260810 18:35:59.712913 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:35:59.703228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:51603 (local address 127.13.139.62:41507)
0810 18:35:59.703534 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0810 18:35:59.703544 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:35:59.703865 (+ 321us) server_negotiation.cc:407] Connection header received
0810 18:35:59.704072 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:35:59.704083 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:35:59.704162 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:35:59.704267 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:35:59.705172 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.705878 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.707373 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:35:59.707876 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:35:59.708025 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:35:59.712736 (+ 4711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:51603: BlockingRecv error: recv got EOF from 127.13.139.1:51603 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 10 18:36:00 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:00 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:00.133031 24203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:00.123720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:35237)
0810 18:36:00.124294 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:00.124311 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:00.124427 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:00.124736 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:00.124739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:00.125192 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:00.125343 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:00.125352 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.126363 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.126366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:00.127347 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:00.127359 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.128114 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.128119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:00.128236 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:00.128823 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:00.128841 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:00.132650 (+ 3809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":343,"threads_started":1}
W20260810 18:36:00.133149 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:00.123767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:35237 (local address 127.13.139.62:41507)
0810 18:36:00.123988 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:00.123998 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:00.124396 (+ 398us) server_negotiation.cc:407] Connection header received
0810 18:36:00.124543 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:00.124547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:00.124610 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:00.124689 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:00.125484 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.126237 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.127521 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.127949 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.128058 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:00.132889 (+ 4831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:35237: BlockingRecv error: recv got EOF from 127.13.139.2:35237 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 10 18:36:00 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:00 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:00.617525 24204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:00.608609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:55555)
0810 18:36:00.609190 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:00.609206 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:00.609316 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:00.609595 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:00.609598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:00.610051 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:00.610214 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:00.610223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.611176 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.611179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:00.612172 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:00.612184 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.612903 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.612908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:00.613088 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:00.613634 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:00.613651 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:00.617185 (+ 3534us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":348,"threads_started":1}
W20260810 18:36:00.617624 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:00.608670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:55555 (local address 127.13.139.62:41507)
0810 18:36:00.608865 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:00.608870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:00.609281 (+ 411us) server_negotiation.cc:407] Connection header received
0810 18:36:00.609422 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:00.609425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:00.609502 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:00.609582 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:00.610346 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.611060 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.612301 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.612752 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.612845 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:00.617377 (+ 4532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:55555: BlockingRecv error: recv got EOF from 127.13.139.3:55555 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 10 18:36:00 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:00 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:00.722855 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:00.713927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:48769)
0810 18:36:00.714438 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:00.714458 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:00.714600 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:00.714933 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:00.714937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:00.715326 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:00.715544 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:00.715553 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.716526 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.716530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:00.717469 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:00.717480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.718112 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.718118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:00.718301 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:00.718883 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:00.718904 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:00.722508 (+ 3604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":256,"threads_started":1}
W20260810 18:36:00.723022 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:00.713995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:48769 (local address 127.13.139.62:41507)
0810 18:36:00.714249 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:00.714256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:00.714557 (+ 301us) server_negotiation.cc:407] Connection header received
0810 18:36:00.714705 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:00.714709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:00.714770 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:00.714848 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:00.715674 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.716402 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.717588 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:00.717960 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:00.718089 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:00.722728 (+ 4639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:48769: BlockingRecv error: recv got EOF from 127.13.139.1:48769 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 10 18:36:01 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:01 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:01.143296 24206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:01.134273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:47773)
0810 18:36:01.134816 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:01.134852 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:01.134986 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:01.135394 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:01.135405 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:01.135983 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:01.136220 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:01.136230 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.137179 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.137182 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:01.138084 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:01.138095 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.138805 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.138811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:01.138984 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:01.139744 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:01.139761 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:01.143060 (+ 3299us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":337,"threads_started":1}
W20260810 18:36:01.143469 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:01.134346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:47773 (local address 127.13.139.62:41507)
0810 18:36:01.134609 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:01.134616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:01.134969 (+ 353us) server_negotiation.cc:407] Connection header received
0810 18:36:01.135137 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:01.135141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:01.135204 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:01.135336 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:01.136350 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.137066 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.138201 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.138635 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.138727 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:01.143240 (+ 4513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:47773: BlockingRecv error: recv got EOF from 127.13.139.2:47773 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 10 18:36:01 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:01 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:01.627892 24207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:01.618537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:46519)
0810 18:36:01.619091 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:01.619107 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:01.619221 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:01.619555 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:01.619559 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:01.619973 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:01.620165 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:01.620173 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.621371 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.621417 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:01.622588 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:01.622600 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.623248 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.623252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:01.623374 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:01.624001 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:01.624018 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:01.627637 (+ 3619us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":353,"threads_started":1}
W20260810 18:36:01.628188 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:01.618722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:46519 (local address 127.13.139.62:41507)
0810 18:36:01.618927 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:01.618932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:01.619183 (+ 251us) server_negotiation.cc:407] Connection header received
0810 18:36:01.619319 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:01.619322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:01.619395 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:01.619501 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:01.620290 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.621194 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.622709 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.623122 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.623217 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:01.627835 (+ 4618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:46519: BlockingRecv error: recv got EOF from 127.13.139.3:46519 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 18:36:01 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:01 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:01.733167 24208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:01.723782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:36823)
0810 18:36:01.724295 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:01.724311 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:01.724475 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:01.724840 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:01.724845 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:01.725253 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:01.725427 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:01.725436 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.726489 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.726501 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:01.727381 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:01.727392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.728301 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.728308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:01.728492 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:01.729204 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:01.729230 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:01.732926 (+ 3696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":287,"threads_started":1}
W20260810 18:36:01.733362 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:01.723892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:36823 (local address 127.13.139.62:41507)
0810 18:36:01.724108 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:01.724117 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:01.724394 (+ 277us) server_negotiation.cc:407] Connection header received
0810 18:36:01.724600 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:01.724606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:01.724686 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:01.724804 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:01.725582 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.726343 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.727590 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:01.728137 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:01.728269 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:01.733150 (+ 4881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:36823: BlockingRecv error: recv got EOF from 127.13.139.1:36823 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 18:36:02 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:02 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:02.154454 24209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:02.144382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:48059)
0810 18:36:02.144906 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:02.144929 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:02.145054 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:02.145361 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:02.145364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:02.145760 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:02.145939 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:02.145949 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.146917 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.146921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:02.148289 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:02.148305 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.149367 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.149373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:02.149588 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:02.150292 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:02.150312 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:02.154110 (+ 3798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":269,"threads_started":1}
W20260810 18:36:02.154597 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:02.144464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:48059 (local address 127.13.139.62:41507)
0810 18:36:02.144698 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:02.144705 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:02.145015 (+ 310us) server_negotiation.cc:407] Connection header received
0810 18:36:02.145160 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:02.145163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:02.145226 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:02.145308 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:02.146066 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.146781 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.148473 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.149193 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.149341 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:02.154341 (+ 5000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:48059: BlockingRecv error: recv got EOF from 127.13.139.2:48059 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 18:36:02 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:02 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:02.639206 24210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:02.629046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:51175)
0810 18:36:02.629614 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:02.629630 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:02.629787 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:02.630128 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:02.630133 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:02.630543 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:02.630738 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:02.630747 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.631865 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.631872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:02.632868 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:02.632879 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.633590 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.633596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:02.633782 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:02.634422 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:02.634440 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:02.638676 (+ 4236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":334,"threads_started":1}
W20260810 18:36:02.639230 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:02.629279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:51175 (local address 127.13.139.62:41507)
0810 18:36:02.629513 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:02.629520 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:02.629709 (+ 189us) server_negotiation.cc:407] Connection header received
0810 18:36:02.629906 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:02.629912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:02.629991 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:02.630093 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:02.630887 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.631726 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.633007 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.633430 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.633570 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:02.639006 (+ 5436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:51175: BlockingRecv error: recv got EOF from 127.13.139.3:51175 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 10 18:36:02 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:02 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:02.743996 24211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:02.734107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:47431)
0810 18:36:02.734640 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:02.734655 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:02.734820 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:02.735272 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:02.735277 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:02.735809 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:02.735977 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:02.735986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.737080 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.737088 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:02.738086 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:02.738097 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.738842 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.738848 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:02.739042 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:02.739717 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:02.739735 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:02.743752 (+ 4017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":295,"threads_started":1}
W20260810 18:36:02.744208 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:02.734184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:47431 (local address 127.13.139.62:41507)
0810 18:36:02.734471 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:02.734478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:02.734748 (+ 270us) server_negotiation.cc:407] Connection header received
0810 18:36:02.734966 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:02.734975 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:02.735091 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:02.735223 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:02.736128 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.736943 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.738232 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:02.738677 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:02.738826 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:02.743981 (+ 5155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:47431: BlockingRecv error: recv got EOF from 127.13.139.1:47431 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
Aug 10 18:36:03 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:03 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:03.167989 24212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:03.155495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:43817)
0810 18:36:03.156020 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:03.156035 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:03.156184 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:03.156561 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:03.156565 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:03.156980 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:03.157139 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:03.157147 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.158135 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.158143 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:03.159182 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:03.159193 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.160174 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.160180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:03.160360 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:03.164271 (+ 3911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:03.164289 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:03.167736 (+ 3447us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":278,"threads_started":1}
W20260810 18:36:03.168133 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:03.155533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:43817 (local address 127.13.139.62:41507)
0810 18:36:03.155755 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:03.155761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:03.156127 (+ 366us) server_negotiation.cc:407] Connection header received
0810 18:36:03.156314 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:03.156319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:03.156402 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:03.156522 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:03.157283 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.158009 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.159325 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.160017 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.160153 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:03.167933 (+ 7780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:43817: BlockingRecv error: recv got EOF from 127.13.139.2:43817 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 18:36:03 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:03 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:03.654696 24213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:03.640199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:32963)
0810 18:36:03.640737 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:03.640754 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:03.640890 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:03.641289 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:03.641292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:03.641669 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:03.641832 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:03.641840 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.642838 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.642842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:03.643872 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:03.643884 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.644569 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.644573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:03.644720 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:03.650780 (+ 6060us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:03.650807 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:03.654423 (+ 3616us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":306,"threads_started":1}
W20260810 18:36:03.654913 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:03.640293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:32963 (local address 127.13.139.62:41507)
0810 18:36:03.640477 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:03.640482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:03.640825 (+ 343us) server_negotiation.cc:407] Connection header received
0810 18:36:03.641083 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:03.641087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:03.641150 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:03.641230 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:03.641993 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.642728 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.644016 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.644405 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.644504 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:03.654666 (+ 10162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:32963: BlockingRecv error: recv got EOF from 127.13.139.3:32963 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 18:36:03 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:03 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:03.753849 24214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:03.745146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:46007)
0810 18:36:03.745680 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:03.745696 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:03.745854 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:03.746291 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:03.746297 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:03.746806 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:03.746977 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:03.746987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.747976 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.747980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:03.748915 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:03.748926 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.749534 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.749538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:03.749658 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:03.750206 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:03.750223 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:03.753614 (+ 3391us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":290,"threads_started":1}
W20260810 18:36:03.754072 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:03.745238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:46007 (local address 127.13.139.62:41507)
0810 18:36:03.745467 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:03.745475 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:03.745786 (+ 311us) server_negotiation.cc:407] Connection header received
0810 18:36:03.746002 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:03.746008 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:03.746096 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:03.746204 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:03.747121 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.747847 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.749041 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:03.749416 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:03.749509 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:03.753807 (+ 4298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:46007: BlockingRecv error: recv got EOF from 127.13.139.1:46007 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 18:36:04 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:04 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:04.178026 24215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:04.168998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:51635)
0810 18:36:04.169561 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:04.169577 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:04.169688 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:04.169989 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:04.169992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:04.170403 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:04.170552 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:04.170560 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.171575 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.171579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:04.172496 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:04.172506 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.173155 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.173159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:04.173278 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:04.173825 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:04.173842 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:04.177747 (+ 3905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":306,"threads_started":1}
W20260810 18:36:04.178140 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:04.169151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:51635 (local address 127.13.139.62:41507)
0810 18:36:04.169324 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:04.169328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:04.169652 (+ 324us) server_negotiation.cc:407] Connection header received
0810 18:36:04.169784 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:04.169788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:04.169850 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:04.169952 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:04.170670 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.171449 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.172613 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.173036 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.173127 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:04.177926 (+ 4799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:51635: BlockingRecv error: recv got EOF from 127.13.139.2:51635 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 10 18:36:04 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:04 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:04.664666 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:04.655701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:60461)
0810 18:36:04.656410 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:04.656442 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:04.656581 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:04.656877 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:04.656880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:04.657298 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:04.657478 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:04.657487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.658460 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.658463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:04.659378 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:04.659389 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.660167 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.660173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:04.660368 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:04.660900 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:04.660916 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:04.664433 (+ 3517us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":439,"threads_started":1}
W20260810 18:36:04.664847 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:04.655768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:60461 (local address 127.13.139.62:41507)
0810 18:36:04.655999 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:04.656008 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:04.656535 (+ 527us) server_negotiation.cc:407] Connection header received
0810 18:36:04.656688 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:04.656692 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:04.656753 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:04.656832 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:04.657601 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.658321 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.659555 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.660019 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.660157 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:04.664621 (+ 4464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:60461: BlockingRecv error: recv got EOF from 127.13.139.3:60461 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 10 18:36:04 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:04 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:04.764146 24217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:04.754756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:42779)
0810 18:36:04.755255 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:04.755271 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:04.755408 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:04.755719 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:04.755722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:04.756133 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:04.756307 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:04.756316 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.757327 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.757331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:04.758279 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:04.758302 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.759011 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.759015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:04.759146 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:04.759813 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:04.759831 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:04.763777 (+ 3946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":286,"threads_started":1}
W20260810 18:36:04.764355 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:04.754862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:42779 (local address 127.13.139.62:41507)
0810 18:36:04.755167 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:04.755174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:04.755368 (+ 194us) server_negotiation.cc:407] Connection header received
0810 18:36:04.755526 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:04.755530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:04.755592 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:04.755664 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:04.756429 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.757177 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.758412 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:04.758863 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:04.758963 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:04.764046 (+ 5083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:42779: BlockingRecv error: recv got EOF from 127.13.139.1:42779 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 10 18:36:05 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:05 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:05.188530 24218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:05.179087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:58723)
0810 18:36:05.179663 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:05.179679 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:05.179838 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:05.180197 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:05.180202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:05.180738 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:05.180963 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:05.180992 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.182163 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.182168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:05.183095 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:05.183106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.183891 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.183897 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:05.184084 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:05.184709 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:05.184727 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:05.188177 (+ 3450us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":332,"threads_started":1}
W20260810 18:36:05.188668 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:05.179295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:58723 (local address 127.13.139.62:41507)
0810 18:36:05.179576 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:05.179583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:05.179762 (+ 179us) server_negotiation.cc:407] Connection header received
0810 18:36:05.179972 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:05.179979 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:05.180052 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:05.180173 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:05.181182 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.182022 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.183233 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.183726 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.183856 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:05.188386 (+ 4530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:58723: BlockingRecv error: recv got EOF from 127.13.139.2:58723 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 10 18:36:05 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:05 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:05.675274 24219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:05.665888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:48383)
0810 18:36:05.666457 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:05.666481 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:05.666603 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:05.666934 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:05.666939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:05.667396 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:05.667647 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:05.667658 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.669043 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.669049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:05.669976 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:05.669987 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.670714 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.670720 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:05.670895 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:05.671473 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:05.671491 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:05.674943 (+ 3452us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":325,"threads_started":1}
W20260810 18:36:05.675372 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:05.665899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:48383 (local address 127.13.139.62:41507)
0810 18:36:05.666067 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:05.666071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:05.666557 (+ 486us) server_negotiation.cc:407] Connection header received
0810 18:36:05.666700 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:05.666704 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:05.666764 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:05.666856 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:05.667803 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.668900 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.670122 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.670555 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.670693 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:05.675132 (+ 4439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:48383: BlockingRecv error: recv got EOF from 127.13.139.3:48383 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 18:36:05 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:05 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:05.773810 24220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:05.765255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:52155)
0810 18:36:05.765844 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:05.765860 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:05.765973 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:05.766260 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:05.766263 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:05.766701 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:05.766887 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:05.766895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.767929 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.767933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:05.768902 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:05.768912 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.769558 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.769562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:05.769670 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:05.770235 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:05.770253 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:05.773558 (+ 3305us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":277,"threads_started":1}
W20260810 18:36:05.773960 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:05.765325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:52155 (local address 127.13.139.62:41507)
0810 18:36:05.765508 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:05.765512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:05.765945 (+ 433us) server_negotiation.cc:407] Connection header received
0810 18:36:05.766071 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:05.766074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:05.766136 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:05.766217 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:05.767018 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.767809 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.769022 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:05.769429 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:05.769520 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:05.773751 (+ 4231us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:52155: BlockingRecv error: recv got EOF from 127.13.139.1:52155 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 18:36:06 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:06 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:06.199087 24221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:06.189608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:42189)
0810 18:36:06.190260 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:06.190276 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:06.190423 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:06.190801 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:06.190807 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:06.191240 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:06.191413 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:06.191444 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.192471 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.192477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:06.193452 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:06.193464 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.194267 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.194275 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:06.194490 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:06.195137 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:06.195174 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:06.198824 (+ 3650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":302,"threads_started":1}
W20260810 18:36:06.199280 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:06.189657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:42189 (local address 127.13.139.62:41507)
0810 18:36:06.189895 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:06.189903 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:06.190362 (+ 459us) server_negotiation.cc:407] Connection header received
0810 18:36:06.190560 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:06.190572 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:06.190636 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:06.190737 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:06.191584 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.192321 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.193596 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.194051 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.194193 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:06.199020 (+ 4827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:42189: BlockingRecv error: recv got EOF from 127.13.139.2:42189 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 10 18:36:06 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:06 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:06.685509 24222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:06.676365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:50465)
0810 18:36:06.677033 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:06.677051 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:06.677163 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:06.677433 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:06.677436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:06.677871 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:06.678041 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:06.678050 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.679032 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.679035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:06.679995 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:06.680006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.680788 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.680797 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:06.680944 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:06.681614 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:06.681631 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:06.685288 (+ 3657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":330,"threads_started":1}
W20260810 18:36:06.685719 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:06.676411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:50465 (local address 127.13.139.62:41507)
0810 18:36:06.676606 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:06.676611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:06.677126 (+ 515us) server_negotiation.cc:407] Connection header received
0810 18:36:06.677247 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:06.677251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:06.677310 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:06.677389 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:06.678157 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.678913 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.680111 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.680617 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.680735 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:06.685477 (+ 4742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:50465: BlockingRecv error: recv got EOF from 127.13.139.3:50465 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 10 18:36:06 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:06 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:06.784212 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:06.774918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:41145)
0810 18:36:06.775586 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:06.775607 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:06.775749 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:06.776105 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:06.776109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:06.776693 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:06.776961 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:06.776974 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.778060 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.778063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:06.779004 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:06.779015 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.779718 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.779722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:06.779831 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:06.780430 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:06.780449 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:06.783967 (+ 3518us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":322,"threads_started":1}
W20260810 18:36:06.784402 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:06.775098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:41145 (local address 127.13.139.62:41507)
0810 18:36:06.775383 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:06.775391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:06.775707 (+ 316us) server_negotiation.cc:407] Connection header received
0810 18:36:06.775852 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:06.775857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:06.775951 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:06.776054 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:06.777113 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.777926 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.779129 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:06.779559 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:06.779652 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:06.784171 (+ 4519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:41145: BlockingRecv error: recv got EOF from 127.13.139.1:41145 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 10 18:36:07 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:07 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:07.210494 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:07.200018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:52907)
0810 18:36:07.200577 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:07.200594 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:07.200707 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:07.201037 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:07.201040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:07.201476 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:07.201647 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:07.201656 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.202873 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.202879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:07.204096 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:07.204112 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.205049 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.205054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:07.205180 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:07.205804 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:07.205824 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:07.210128 (+ 4304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":276,"threads_started":1}
W20260810 18:36:07.210659 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:07.200087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:52907 (local address 127.13.139.62:41507)
0810 18:36:07.200263 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:07.200268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:07.200664 (+ 396us) server_negotiation.cc:407] Connection header received
0810 18:36:07.200816 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:07.200820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:07.200880 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:07.200978 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:07.201779 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.202684 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.204252 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.204815 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.204970 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:07.210402 (+ 5432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:52907: BlockingRecv error: recv got EOF from 127.13.139.2:52907 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 18:36:07 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:07 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:07.695629 24225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:07.686375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:58277)
0810 18:36:07.686990 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:07.687012 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:07.687137 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:07.687486 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:07.687494 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:07.687909 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:07.688079 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:07.688087 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.689184 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.689188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:07.690209 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:07.690222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.690915 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.690919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:07.691053 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:07.691816 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:07.691841 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:07.695357 (+ 3516us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":328,"threads_started":1}
W20260810 18:36:07.695858 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:07.686472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:58277 (local address 127.13.139.62:41507)
0810 18:36:07.686664 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:07.686671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:07.687096 (+ 425us) server_negotiation.cc:407] Connection header received
0810 18:36:07.687236 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:07.687240 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:07.687302 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:07.687383 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:07.688198 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.689067 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.690333 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.690762 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.690857 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:07.695614 (+ 4757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:58277: BlockingRecv error: recv got EOF from 127.13.139.3:58277 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 18:36:07 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:07 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:07.794517 24226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:07.785314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:53829)
0810 18:36:07.785884 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:07.785900 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:07.786029 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:07.786363 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:07.786367 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:07.786874 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:07.787105 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:07.787115 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.788389 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.788398 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:07.789455 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:07.789467 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.790240 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.790245 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:07.790367 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:07.790932 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:07.790963 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:07.794273 (+ 3310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":327,"threads_started":1}
W20260810 18:36:07.794651 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:07.785361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:53829 (local address 127.13.139.62:41507)
0810 18:36:07.785566 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:07.785571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:07.785989 (+ 418us) server_negotiation.cc:407] Connection header received
0810 18:36:07.786133 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:07.786137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:07.786199 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:07.786282 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:07.787267 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.788225 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.789587 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:07.790075 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:07.790169 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:07.794440 (+ 4271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:53829: BlockingRecv error: recv got EOF from 127.13.139.1:53829 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 10 18:36:08 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:08 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:08.221402 24227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:08.211704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:49285)
0810 18:36:08.212322 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:08.212338 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:08.212474 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:08.212790 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:08.212793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:08.213225 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:08.213395 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:08.213403 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.214580 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.214586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:08.215707 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:08.215720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.216675 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.216680 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:08.216811 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:08.217563 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:08.217580 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:08.221170 (+ 3590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":367,"threads_started":1}
W20260810 18:36:08.221674 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:08.211751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:49285 (local address 127.13.139.62:41507)
0810 18:36:08.211977 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:08.211982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:08.212447 (+ 465us) server_negotiation.cc:407] Connection header received
0810 18:36:08.212578 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:08.212582 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:08.212646 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:08.212739 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:08.213563 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.214428 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.215836 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.216518 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.216665 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:08.221381 (+ 4716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:49285: BlockingRecv error: recv got EOF from 127.13.139.2:49285 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 10 18:36:08 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:08 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:08.710799 24228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:08.696644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:43725)
0810 18:36:08.697146 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:08.697162 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:08.697306 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:08.697667 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:08.697673 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:08.698120 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:08.698261 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:08.698270 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.699267 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.699276 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:08.700270 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:08.700281 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.701030 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.701036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:08.701242 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:08.706611 (+ 5369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:08.706630 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:08.710561 (+ 3931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":276,"threads_started":1}
W20260810 18:36:08.711009 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:08.696680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:43725 (local address 127.13.139.62:41507)
0810 18:36:08.696873 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:08.696882 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:08.697246 (+ 364us) server_negotiation.cc:407] Connection header received
0810 18:36:08.697445 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:08.697452 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:08.697520 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:08.697620 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:08.698405 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.699137 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.700409 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.700838 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.700982 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:08.710789 (+ 9807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:43725: BlockingRecv error: recv got EOF from 127.13.139.3:43725 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 18:36:08 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:08 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:08.804740 24231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:08.795511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:49653)
0810 18:36:08.796112 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:08.796132 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:08.796295 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:08.796701 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:08.796706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:08.797245 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:08.797436 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:08.797445 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.798450 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.798453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:08.799409 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:08.799475 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.800213 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.800217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:08.800333 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:08.801018 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:08.801035 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:08.804515 (+ 3480us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":277,"threads_started":1}
W20260810 18:36:08.805117 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:08.795644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:49653 (local address 127.13.139.62:41507)
0810 18:36:08.795914 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:08.795920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:08.796257 (+ 337us) server_negotiation.cc:407] Connection header received
0810 18:36:08.796441 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:08.796445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:08.796534 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:08.796633 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:08.797580 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.798344 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.799609 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:08.800081 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:08.800184 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:08.804703 (+ 4519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:49653: BlockingRecv error: recv got EOF from 127.13.139.1:49653 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 10 18:36:09 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:09 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:09.231843 24232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:09.222324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:60291)
0810 18:36:09.222846 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:09.222863 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:09.222980 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:09.223271 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:09.223274 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:09.223778 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:09.223927 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:09.223936 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.225029 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.225033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:09.226010 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:09.226021 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.226785 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.226790 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:09.226906 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:09.227692 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:09.227708 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:09.231523 (+ 3815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":270,"threads_started":1}
W20260810 18:36:09.232071 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:09.222438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:60291 (local address 127.13.139.62:41507)
0810 18:36:09.222706 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:09.222713 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:09.222951 (+ 238us) server_negotiation.cc:407] Connection header received
0810 18:36:09.223083 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:09.223087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:09.223155 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:09.223232 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:09.224083 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.224889 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.226153 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.226649 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.226753 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:09.231795 (+ 5042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:60291: BlockingRecv error: recv got EOF from 127.13.139.2:60291 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 10 18:36:09 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:09 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:09.721271 24233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:09.711765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:53069)
0810 18:36:09.712376 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:09.712427 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:09.712577 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:09.713062 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:09.713069 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:09.713569 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:09.713774 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:09.713787 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.715174 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.715180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:09.716198 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:09.716210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.716983 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.716987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:09.717112 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:09.717670 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:09.717687 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:09.721044 (+ 3357us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":374,"threads_started":1}
W20260810 18:36:09.721501 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:09.712037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:53069 (local address 127.13.139.62:41507)
0810 18:36:09.712257 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:09.712263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:09.712524 (+ 261us) server_negotiation.cc:407] Connection header received
0810 18:36:09.712822 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:09.712826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:09.712908 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:09.712992 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:09.713960 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.715033 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.716344 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.716807 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.716964 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:09.721218 (+ 4254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:53069: BlockingRecv error: recv got EOF from 127.13.139.3:53069 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 10 18:36:09 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:09 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:09.815325 24234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:09.805640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:60497)
0810 18:36:09.806174 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:09.806190 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:09.806300 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:09.806617 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:09.806620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:09.807050 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:09.807236 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:09.807247 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.808406 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.808410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:09.809765 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:09.809777 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.810448 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.810452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:09.810575 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:09.811217 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:09.811235 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:09.815105 (+ 3870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":305,"threads_started":1}
W20260810 18:36:09.815577 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:09.805751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:60497 (local address 127.13.139.62:41507)
0810 18:36:09.805922 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:09.805927 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:09.806263 (+ 336us) server_negotiation.cc:407] Connection header received
0810 18:36:09.806395 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:09.806399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:09.806490 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:09.806571 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:09.807362 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.808245 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.809890 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:09.810321 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:09.810428 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:09.815297 (+ 4869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:60497: BlockingRecv error: recv got EOF from 127.13.139.1:60497 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 18:36:10 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:10 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:10.242455 24235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:10.232850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:44827)
0810 18:36:10.233365 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:10.233379 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:10.233550 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:10.233883 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:10.233888 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:10.234346 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:10.234528 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:10.234537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.235695 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.235701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:10.237204 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:10.237217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.237889 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.237894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:10.238020 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:10.238727 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:10.238745 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:10.242230 (+ 3485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":247,"threads_started":1}
W20260810 18:36:10.242636 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:10.232965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:44827 (local address 127.13.139.62:41507)
0810 18:36:10.233187 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:10.233194 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:10.233478 (+ 284us) server_negotiation.cc:407] Connection header received
0810 18:36:10.233677 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:10.233687 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:10.233748 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:10.233851 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:10.234678 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.235545 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.237343 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.237759 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.237856 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:10.242414 (+ 4558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:44827: BlockingRecv error: recv got EOF from 127.13.139.2:44827 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 10 18:36:10 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:10 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:10.731534 24236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:10.722144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:40681)
0810 18:36:10.722662 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:10.722681 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:10.722809 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:10.723089 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:10.723093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:10.723573 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:10.723765 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:10.723774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.724767 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.724785 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:10.725738 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:10.725750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.726472 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.726478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:10.726682 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:10.727303 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:10.727321 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:10.731111 (+ 3790us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":305,"threads_started":1}
W20260810 18:36:10.731643 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:10.722226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:40681 (local address 127.13.139.62:41507)
0810 18:36:10.722386 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:10.722391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:10.722771 (+ 380us) server_negotiation.cc:407] Connection header received
0810 18:36:10.722900 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:10.722904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:10.722963 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:10.723039 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:10.723879 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.724615 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.725893 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.726308 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.726459 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:10.731321 (+ 4862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:40681: BlockingRecv error: recv got EOF from 127.13.139.3:40681 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 18:36:10 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:10 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:10.826051 24237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:10.816328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:35151)
0810 18:36:10.816919 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:10.816934 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:10.817112 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:10.817473 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:10.817478 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:10.817936 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:10.818103 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:10.818113 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.819329 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.819338 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:10.820388 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:10.820399 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.821157 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.821163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:10.821365 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:10.821996 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:10.822014 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:10.825639 (+ 3625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":313,"threads_started":1}
W20260810 18:36:10.826092 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:10.816451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:35151 (local address 127.13.139.62:41507)
0810 18:36:10.816729 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:10.816735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:10.817045 (+ 310us) server_negotiation.cc:407] Connection header received
0810 18:36:10.817244 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:10.817253 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:10.817337 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:10.817443 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:10.818255 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.819184 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.820539 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:10.820994 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:10.821130 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:10.825837 (+ 4707us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:35151: BlockingRecv error: recv got EOF from 127.13.139.1:35151 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 10 18:36:11 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:11 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:11.252264 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:11.243544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:46987)
0810 18:36:11.244036 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:11.244053 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:11.244173 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:11.244457 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:11.244460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:11.244867 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:11.245041 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:11.245050 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.246008 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.246012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:11.246937 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:11.246948 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.247599 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.247603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:11.247737 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:11.248321 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:11.248338 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:11.252006 (+ 3668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":268,"threads_started":1}
W20260810 18:36:11.252455 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:11.243629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:46987 (local address 127.13.139.62:41507)
0810 18:36:11.243867 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:11.243873 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:11.244136 (+ 263us) server_negotiation.cc:407] Connection header received
0810 18:36:11.244256 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:11.244260 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:11.244323 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:11.244401 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:11.245162 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.245883 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.247054 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.247479 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.247568 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:11.252215 (+ 4647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:46987: BlockingRecv error: recv got EOF from 127.13.139.2:46987 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 18:36:11 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:11 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:11.743543 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:11.732652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:60987)
0810 18:36:11.733259 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:11.733276 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:11.733437 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:11.733792 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:11.733797 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:11.734351 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:11.734611 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:11.734624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.736002 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.736009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:11.737498 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:11.737513 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.738296 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.738302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:11.738493 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:11.739170 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:11.739192 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:11.743141 (+ 3949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":343,"threads_started":1}
W20260810 18:36:11.743667 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:11.732708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:60987 (local address 127.13.139.62:41507)
0810 18:36:11.733043 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:11.733052 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:11.733364 (+ 312us) server_negotiation.cc:407] Connection header received
0810 18:36:11.733574 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:11.733578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:11.733639 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:11.733760 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:11.734814 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.735862 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.737648 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.738125 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.738225 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:11.743365 (+ 5140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:60987: BlockingRecv error: recv got EOF from 127.13.139.3:60987 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 10 18:36:11 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:11 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:11.838029 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:11.827356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:51683)
0810 18:36:11.827946 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:11.827964 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:11.828149 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:11.828584 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:11.828589 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:11.829084 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:11.829242 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:11.829251 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.830734 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.830741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:11.831847 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:11.831860 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.832697 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.832703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:11.832909 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:11.833681 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:11.833702 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:11.837566 (+ 3864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":334,"threads_started":1}
W20260810 18:36:11.838065 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:11.827471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:51683 (local address 127.13.139.62:41507)
0810 18:36:11.827756 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:11.827765 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:11.828075 (+ 310us) server_negotiation.cc:407] Connection header received
0810 18:36:11.828296 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:11.828302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:11.828427 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:11.828550 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:11.829414 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.830585 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.832065 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:11.832530 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:11.832687 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:11.837811 (+ 5124us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:51683: BlockingRecv error: recv got EOF from 127.13.139.1:51683 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 10 18:36:12 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:12 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:12.262269 24241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:12.253288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:35521)
0810 18:36:12.253769 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:12.253786 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:12.253897 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:12.254193 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:12.254196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:12.254609 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:12.254759 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:12.254767 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.255879 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.255882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:12.256812 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:12.256823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.257548 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.257552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:12.257677 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:12.258276 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:12.258293 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:12.262025 (+ 3732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":268,"threads_started":1}
W20260810 18:36:12.262540 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:12.253411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:35521 (local address 127.13.139.62:41507)
0810 18:36:12.253642 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:12.253649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:12.253866 (+ 217us) server_negotiation.cc:407] Connection header received
0810 18:36:12.254000 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:12.254004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:12.254070 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:12.254155 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:12.254888 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.255757 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.256942 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.257421 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.257519 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:12.262235 (+ 4716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:35521: BlockingRecv error: recv got EOF from 127.13.139.2:35521 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 10 18:36:12 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:12 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.3@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:12.753597 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:12.744574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.3:34499)
0810 18:36:12.745042 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:12.745059 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:12.745170 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:12.745461 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:12.745464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:12.745870 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:12.746031 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:12.746039 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.747036 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.747039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:12.748003 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:12.748015 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.748682 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.748686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:12.748803 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:12.749412 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:12.749429 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:12.753258 (+ 3829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":264,"threads_started":1}
W20260810 18:36:12.753713 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:12.744625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:34499 (local address 127.13.139.62:41507)
0810 18:36:12.744854 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:12.744863 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:12.745141 (+ 278us) server_negotiation.cc:407] Connection header received
0810 18:36:12.745270 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:12.745274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:12.745335 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:12.745425 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:12.746150 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.746902 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.748140 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.748556 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.748652 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:12.753481 (+ 4829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.3:34499: BlockingRecv error: recv got EOF from 127.13.139.3:34499 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 10 18:36:12 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:12 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.1@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:12.849085 24243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:12.839383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.1:60319)
0810 18:36:12.839959 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:12.839977 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:12.840138 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:12.840542 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:12.840547 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:12.840977 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:12.841155 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:12.841164 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.842188 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.842193 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:12.843138 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:12.843148 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.843985 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.843990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:12.844177 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:12.844752 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:12.844781 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:12.848702 (+ 3921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":283,"threads_started":1}
W20260810 18:36:12.849146 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:12.839491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:60319 (local address 127.13.139.62:41507)
0810 18:36:12.839802 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:12.839809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:12.840067 (+ 258us) server_negotiation.cc:407] Connection header received
0810 18:36:12.840265 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:12.840270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:12.840396 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:12.840507 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:12.841297 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.842041 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.843279 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:12.843836 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:12.843973 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:12.848892 (+ 4919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.1:60319: BlockingRecv error: recv got EOF from 127.13.139.1:60319 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
Aug 10 18:36:13 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 18:36:13 dist-test-slave-5k54 krb5kdc[23062](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.139.2@KRBTEST.COM for oryx/127.13.139.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 18:36:13.276602 24245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:13.263724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:41507 (local address 127.13.139.2:38289)
0810 18:36:13.264281 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:13.264303 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:13.264454 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:13.264951 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:13.264957 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:13.265503 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:13.265767 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:13.265783 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.267379 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.267385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:13.269056 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:13.269074 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.270428 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.270437 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:13.270671 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:13.271534 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:13.271563 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:13.276183 (+ 4620us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.139.62:41507: Server oryx/127.13.139.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":279,"threads_started":1}
W20260810 18:36:13.276726 24195 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:13.263796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:38289 (local address 127.13.139.62:41507)
0810 18:36:13.263965 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:13.263970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:13.264372 (+ 402us) server_negotiation.cc:407] Connection header received
0810 18:36:13.264668 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:13.264675 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:13.264747 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:13.264864 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:13.265926 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.267217 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.269230 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.270009 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.270160 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:13.276459 (+ 6299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.139.2:38289: BlockingRecv error: recv got EOF from 127.13.139.2:38289 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 18:36:13.359557 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23728
I20260810 18:36:13.371882 24247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:13.360618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45882 (local address 127.13.139.1:38635)
0810 18:36:13.361224 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:13.361232 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:13.361259 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:36:13.361325 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:13.361331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:13.361574 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:13.361790 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:13.363267 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.364528 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.365684 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.366199 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.366295 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:13.368781 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:13.368790 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:13.368802 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:13.368846 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:13.371346 (+ 2500us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.139.1@KRBTEST.COM not found in keytab (ticket kvno 2)
0810 18:36:13.371684 (+ 338us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45882: Request ticket server kudu/127.13.139.1@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":329,"threads_started":1}
W20260810 18:36:13.372018 24247 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45882: Request ticket server kudu/127.13.139.1@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260810 18:36:13.372025 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23728: Not authorized: Client connection negotiation failed: client connection to 127.13.139.1:38635: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.139.1@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260810 18:36:13.372252 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 23728
I20260810 18:36:13.393071 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23901
I20260810 18:36:13.405831 24248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:13.394197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37578 (local address 127.13.139.2:34407)
0810 18:36:13.394893 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:13.394902 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:13.394939 (+ 37us) server_negotiation.cc:407] Connection header received
0810 18:36:13.395015 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:13.395024 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:13.395343 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:13.395609 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:13.396848 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.398006 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.399189 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.399835 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.399941 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:13.402339 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:13.402348 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:13.402360 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:13.402412 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:13.405108 (+ 2696us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.139.2@KRBTEST.COM not found in keytab (ticket kvno 2)
0810 18:36:13.405484 (+ 376us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37578: Request ticket server kudu/127.13.139.2@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":312,"threads_started":1}
W20260810 18:36:13.405822 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23901: Not authorized: Client connection negotiation failed: client connection to 127.13.139.2:34407: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.139.2@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260810 18:36:13.405946 24248 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37578: Request ticket server kudu/127.13.139.2@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260810 18:36:13.405994 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 23901
I20260810 18:36:13.425309 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24053
I20260810 18:36:13.438446 24249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:13.426483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37502 (local address 127.13.139.3:40257)
0810 18:36:13.427090 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:13.427098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:13.427124 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:36:13.427190 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:13.427197 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:13.427520 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:13.427757 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:13.429147 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.430227 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.431584 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:13.432266 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:13.432417 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:13.435061 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:13.435070 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:13.435084 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:13.435143 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:13.437904 (+ 2761us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.139.3@KRBTEST.COM not found in keytab (ticket kvno 2)
0810 18:36:13.438192 (+ 288us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37502: Request ticket server kudu/127.13.139.3@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":302,"threads_started":1}
W20260810 18:36:13.438587 24249 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37502: Request ticket server kudu/127.13.139.3@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260810 18:36:13.438565 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24053: Not authorized: Client connection negotiation failed: client connection to 127.13.139.3:40257: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.139.3@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260810 18:36:13.438741 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 24053
I20260810 18:36:13.459071 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 23650
I20260810 18:36:13.460561 23719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:13.579721 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 23650
2026-08-10T18:36:13Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21529 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T18:36:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:36:13Z Disabled control of system clock
I20260810 18:36:13.669740 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:45943
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:45943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 18:36:14.011937 24255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:14.012248 24255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:14.012331 24255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:14.019621 24255 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:36:14.019729 24255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:14.019771 24255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:14.019820 24255 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:36:14.019866 24255 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:36:14.029160 24255 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:45943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:45943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:14.030525 24255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:14.032522 24255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:14.044992 24261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:14.045022 24264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:14.045321 24260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:14.045706 24255 server_base.cc:1034] running on GCE node
I20260810 18:36:14.046527 24255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:14.047973 24255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:14.049178 24255 hybrid_clock.cc:648] HybridClock initialized: now 1786386974049142 us; error 29 us; skew 500 ppm
I20260810 18:36:14.049543 24255 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:14.051869 24255 webserver.cc:460] Webserver started at http://127.13.139.62:40301/ using document root <none> and password file <none>
I20260810 18:36:14.052642 24255 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:14.052757 24255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:14.053112 24255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:14.056058 24255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "865f2cd8ff4a414abf099b7c84f31dac"
format_stamp: "Formatted at 2026-08-10 18:36:14 on dist-test-slave-5k54"
server_key: "16b93ad4c29faa5490d81aea1503ee55"
server_key_iv: "44a2184a59cb7814de2667982c74296f"
server_key_version: "encryptionkey@0"
I20260810 18:36:14.056857 24255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "865f2cd8ff4a414abf099b7c84f31dac"
format_stamp: "Formatted at 2026-08-10 18:36:14 on dist-test-slave-5k54"
server_key: "16b93ad4c29faa5490d81aea1503ee55"
server_key_iv: "44a2184a59cb7814de2667982c74296f"
server_key_version: "encryptionkey@0"
I20260810 18:36:14.061918 24255 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:36:14.065483 24270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:14.066866 24255 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260810 18:36:14.067060 24255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "865f2cd8ff4a414abf099b7c84f31dac"
format_stamp: "Formatted at 2026-08-10 18:36:14 on dist-test-slave-5k54"
server_key: "16b93ad4c29faa5490d81aea1503ee55"
server_key_iv: "44a2184a59cb7814de2667982c74296f"
server_key_version: "encryptionkey@0"
I20260810 18:36:14.067286 24255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:14.085011 24255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:14.085880 24255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:14.086182 24255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:14.105527 24255 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:45943
I20260810 18:36:14.105549 24326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:45943 every 8 connection(s)
I20260810 18:36:14.106928 24255 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:36:14.110759 24327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:36:14.113976 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 24255
I20260810 18:36:14.114192 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:36:14.115059 13868 external_mini_cluster.cc:1428] Setting key 3c9310fee8b5807ebaf230c03f29c47f
I20260810 18:36:14.124019 24327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac: Bootstrap starting.
I20260810 18:36:14.127954 24327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac: Neither blocks nor log segments found. Creating new log.
I20260810 18:36:14.129096 24327 log.cc:824] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac: Log is configured to *not* fsync() on all Append() calls
I20260810 18:36:14.129590 24330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:14.117296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50292 (local address 127.13.139.62:45943)
0810 18:36:14.118248 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:14.118259 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:14.118300 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:36:14.119995 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:14.120016 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:14.120519 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:14.120853 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:14.121530 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:14.122824 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:14.124730 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:14.125424 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:14.125586 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:14.126985 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:14.126994 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:14.127007 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:14.127604 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:14.127701 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:14.127728 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:14.127817 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:14.128221 (+ 404us) server_negotiation.cc:299] Negotiation successful
0810 18:36:14.128557 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":361,"threads_started":1}
I20260810 18:36:14.132591 24327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac: No bootstrap required, opened a new log
I20260810 18:36:14.140295 24327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865f2cd8ff4a414abf099b7c84f31dac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45943 } }
I20260810 18:36:14.140668 24327 raft_consensus.cc:374] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:36:14.140784 24327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 865f2cd8ff4a414abf099b7c84f31dac, State: Initialized, Role: FOLLOWER
I20260810 18:36:14.141319 24327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865f2cd8ff4a414abf099b7c84f31dac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45943 } }
I20260810 18:36:14.141583 24327 raft_consensus.cc:388] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:36:14.141737 24327 raft_consensus.cc:482] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:36:14.141904 24327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:36:14.144488 24327 raft_consensus.cc:504] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865f2cd8ff4a414abf099b7c84f31dac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45943 } }
I20260810 18:36:14.144999 24327 leader_election.cc:302] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 865f2cd8ff4a414abf099b7c84f31dac; no voters:
I20260810 18:36:14.145633 24327 leader_election.cc:288] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:36:14.145779 24334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:36:14.146862 24334 raft_consensus.cc:686] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [term 1 LEADER]: Becoming Leader. State: Replica: 865f2cd8ff4a414abf099b7c84f31dac, State: Running, Role: LEADER
I20260810 18:36:14.147372 24334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865f2cd8ff4a414abf099b7c84f31dac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45943 } }
I20260810 18:36:14.147684 24327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:36:14.150168 24336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 865f2cd8ff4a414abf099b7c84f31dac. Latest consensus state: current_term: 1 leader_uuid: "865f2cd8ff4a414abf099b7c84f31dac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865f2cd8ff4a414abf099b7c84f31dac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45943 } } }
I20260810 18:36:14.150568 24336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [sys.catalog]: This master's current role is: LEADER
I20260810 18:36:14.151201 24335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "865f2cd8ff4a414abf099b7c84f31dac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865f2cd8ff4a414abf099b7c84f31dac" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 45943 } } }
I20260810 18:36:14.151625 24335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac [sys.catalog]: This master's current role is: LEADER
I20260810 18:36:14.156886 24345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:36:14.162290 24345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:36:14.171808 24345 catalog_manager.cc:1347] Generated new cluster ID: 68b627eb9a5c4a058493d76e9a3b3c41
I20260810 18:36:14.171955 24345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:36:14.195477 24345 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:36:14.196789 24345 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:36:14.210237 24345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 865f2cd8ff4a414abf099b7c84f31dac: Generated new TSK 0
I20260810 18:36:14.211879 24345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:36:14.233956 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45943
--builtin_ntp_servers=127.13.139.20:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 18:36:14.782644 24357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:14.783094 24357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:14.783201 24357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:14.794602 24357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:14.794763 24357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:14.794981 24357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:36:14.809377 24357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:14.811309 24357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:14.814291 24357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:14.835098 24362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:14.835130 24363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:14.835198 24365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:14.837234 24357 server_base.cc:1034] running on GCE node
I20260810 18:36:14.838321 24357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:14.839924 24357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:14.841224 24357 hybrid_clock.cc:648] HybridClock initialized: now 1786386974841130 us; error 61 us; skew 500 ppm
I20260810 18:36:14.841773 24357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:14.845397 24357 webserver.cc:460] Webserver started at http://127.13.139.1:45221/ using document root <none> and password file <none>
I20260810 18:36:14.846555 24357 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:14.846709 24357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:14.847170 24357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:14.852362 24357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "130c213c7d464d06b6e0338fdcc56b5d"
format_stamp: "Formatted at 2026-08-10 18:36:14 on dist-test-slave-5k54"
server_key: "882e91e2452cc14679bd23ef1c9cb9dd"
server_key_iv: "1635c4c9f995b0f407a00e0442937a9b"
server_key_version: "encryptionkey@0"
I20260810 18:36:14.853684 24357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "130c213c7d464d06b6e0338fdcc56b5d"
format_stamp: "Formatted at 2026-08-10 18:36:14 on dist-test-slave-5k54"
server_key: "882e91e2452cc14679bd23ef1c9cb9dd"
server_key_iv: "1635c4c9f995b0f407a00e0442937a9b"
server_key_version: "encryptionkey@0"
I20260810 18:36:14.862840 24357 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.008s
I20260810 18:36:14.868531 24372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:14.871722 24357 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:36:14.872006 24357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "130c213c7d464d06b6e0338fdcc56b5d"
format_stamp: "Formatted at 2026-08-10 18:36:14 on dist-test-slave-5k54"
server_key: "882e91e2452cc14679bd23ef1c9cb9dd"
server_key_iv: "1635c4c9f995b0f407a00e0442937a9b"
server_key_version: "encryptionkey@0"
I20260810 18:36:14.872437 24357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:14.919548 24357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:14.920746 24357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:14.921166 24357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:14.922654 24357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:14.924957 24357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:14.925074 24357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:14.925202 24357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:14.925297 24357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:14.978237 24357 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:32915
I20260810 18:36:14.978367 24496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:32915 every 8 connection(s)
I20260810 18:36:14.980432 24357 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:36:14.988945 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 24357
I20260810 18:36:14.989295 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:36:14.990969 13868 external_mini_cluster.cc:1428] Setting key a204bbc86f06eb6c539709c536b693f7
I20260810 18:36:14.996142 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45943
--builtin_ntp_servers=127.13.139.20:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 18:36:15.006992 24500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:14.984996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:55069 (local address 127.13.139.62:45943)
0810 18:36:14.985778 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:14.985784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:14.987675 (+ 1891us) server_negotiation.cc:407] Connection header received
0810 18:36:14.992698 (+ 5023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:14.992706 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:14.992877 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:14.993074 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:14.995335 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:14.996756 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.001316 (+ 4560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.002025 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.002209 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:15.005342 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:15.005351 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:15.005542 (+ 191us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:15.005593 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:15.005686 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:15.005718 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:15.005882 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:15.006386 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 18:36:15.006552 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":453,"threads_started":1}
I20260810 18:36:15.009992 24501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:14.985839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:45943 (local address 127.13.139.1:55069)
0810 18:36:14.987336 (+ 1497us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:14.987410 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:14.992186 (+ 4776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:14.993541 (+ 1355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:14.993563 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:14.993722 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:14.995039 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:14.995089 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:14.997010 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:14.997031 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:15.001081 (+ 4050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:15.001113 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.002409 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.002432 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:15.003107 (+ 675us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:15.004538 (+ 1431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:36:15.004545 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:15.004672 (+ 127us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:36:15.004897 (+ 225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:15.005899 (+ 1002us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:15.005927 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:15.005953 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 18:36:15.006309 (+ 356us) client_negotiation.cc:240] Negotiation successful
0810 18:36:15.007126 (+ 817us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":455,"threads_started":1}
I20260810 18:36:15.013046 24497 heartbeater.cc:347] Connected to a master server at 127.13.139.62:45943
I20260810 18:36:15.013589 24497 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:15.014834 24497 heartbeater.cc:511] Master 127.13.139.62:45943 requested a full tablet report, sending...
I20260810 18:36:15.018340 24289 ts_manager.cc:194] Registered new tserver with Master: 130c213c7d464d06b6e0338fdcc56b5d (127.13.139.1:32915)
I20260810 18:36:15.020789 24289 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.1:55069
W20260810 18:36:15.409879 24502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:15.410226 24502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:15.410401 24502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:15.417564 24502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:15.417708 24502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:15.417888 24502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:36:15.426787 24502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:15.428098 24502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:15.429843 24502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:15.442615 24511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:15.443033 24508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:15.443058 24509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:15.444172 24502 server_base.cc:1034] running on GCE node
I20260810 18:36:15.444765 24502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:15.445706 24502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:15.446905 24502 hybrid_clock.cc:648] HybridClock initialized: now 1786386975446831 us; error 63 us; skew 500 ppm
I20260810 18:36:15.447224 24502 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:15.449674 24502 webserver.cc:460] Webserver started at http://127.13.139.2:44955/ using document root <none> and password file <none>
I20260810 18:36:15.450385 24502 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:15.450474 24502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:15.450785 24502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:15.453701 24502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "e5ff183dcc6e4d00b57a47937a852f0f"
format_stamp: "Formatted at 2026-08-10 18:36:15 on dist-test-slave-5k54"
server_key: "c4746313c8666610d8db7ce7cc02a6ae"
server_key_iv: "ed9f8cd085f2a25b360a3fc6f3a0115a"
server_key_version: "encryptionkey@0"
I20260810 18:36:15.454504 24502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "e5ff183dcc6e4d00b57a47937a852f0f"
format_stamp: "Formatted at 2026-08-10 18:36:15 on dist-test-slave-5k54"
server_key: "c4746313c8666610d8db7ce7cc02a6ae"
server_key_iv: "ed9f8cd085f2a25b360a3fc6f3a0115a"
server_key_version: "encryptionkey@0"
I20260810 18:36:15.459843 24502 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260810 18:36:15.463599 24518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:15.464895 24502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:36:15.465063 24502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "e5ff183dcc6e4d00b57a47937a852f0f"
format_stamp: "Formatted at 2026-08-10 18:36:15 on dist-test-slave-5k54"
server_key: "c4746313c8666610d8db7ce7cc02a6ae"
server_key_iv: "ed9f8cd085f2a25b360a3fc6f3a0115a"
server_key_version: "encryptionkey@0"
I20260810 18:36:15.465277 24502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:15.491048 24502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:15.491976 24502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:15.492291 24502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:15.493319 24502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:15.494767 24502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:15.494905 24502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:15.495041 24502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:15.495138 24502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:15.529212 24502 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:45917
I20260810 18:36:15.529309 24641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:45917 every 8 connection(s)
I20260810 18:36:15.530532 24502 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:36:15.540206 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 24502
I20260810 18:36:15.540380 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:36:15.540841 13868 external_mini_cluster.cc:1428] Setting key ee5e4939e24c4c3af2f156cde6288c84
I20260810 18:36:15.543112 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:15.533249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:51491 (local address 127.13.139.62:45943)
0810 18:36:15.533706 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:15.533711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:15.534767 (+ 1056us) server_negotiation.cc:407] Connection header received
0810 18:36:15.536588 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:15.536594 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:15.536687 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:15.536808 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:15.537843 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.538575 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.540158 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.540680 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.540830 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:15.542233 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:15.542238 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:15.542241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:15.542258 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:15.542297 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:15.542310 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:15.542419 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:15.542697 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 18:36:15.542796 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":248,"threads_started":1}
I20260810 18:36:15.544076 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45943
--builtin_ntp_servers=127.13.139.20:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 18:36:15.544368 24645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:15.533706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:45943 (local address 127.13.139.2:51491)
0810 18:36:15.534600 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:15.534635 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:15.536322 (+ 1687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:15.537034 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:15.537041 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:15.537121 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:15.537666 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:15.537683 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.538722 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.538734 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:15.540008 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:15.540019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.540905 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.540911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:15.541146 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:15.541885 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:36:15.541888 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:15.541948 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:36:15.542032 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:15.542417 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:15.542428 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:15.542438 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 18:36:15.542644 (+ 206us) client_negotiation.cc:240] Negotiation successful
0810 18:36:15.543022 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":272,"threads_started":1}
I20260810 18:36:15.545691 24642 heartbeater.cc:347] Connected to a master server at 127.13.139.62:45943
I20260810 18:36:15.546015 24642 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:15.546917 24642 heartbeater.cc:511] Master 127.13.139.62:45943 requested a full tablet report, sending...
I20260810 18:36:15.548453 24289 ts_manager.cc:194] Registered new tserver with Master: e5ff183dcc6e4d00b57a47937a852f0f (127.13.139.2:45917)
I20260810 18:36:15.549309 24289 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.2:51491
W20260810 18:36:15.881102 24646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:15.881412 24646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:15.881568 24646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:15.888834 24646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:15.888978 24646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:15.889154 24646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:36:15.897992 24646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:45943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:15.899340 24646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:15.901160 24646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:15.914058 24652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:15.914026 24651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:15.914088 24655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:15.914860 24646 server_base.cc:1034] running on GCE node
I20260810 18:36:15.915522 24646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:15.916469 24646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:15.917701 24646 hybrid_clock.cc:648] HybridClock initialized: now 1786386975917660 us; error 57 us; skew 500 ppm
I20260810 18:36:15.918037 24646 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:15.920377 24646 webserver.cc:460] Webserver started at http://127.13.139.3:35673/ using document root <none> and password file <none>
I20260810 18:36:15.921088 24646 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:15.921222 24646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:15.921553 24646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:15.924556 24646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "260c8ff9a4fa4b5182db08c581b09a4a"
format_stamp: "Formatted at 2026-08-10 18:36:15 on dist-test-slave-5k54"
server_key: "565a086696371135c7339f40afaeabfa"
server_key_iv: "7639925d53d3ee6a52105f55a94300e3"
server_key_version: "encryptionkey@0"
I20260810 18:36:15.925398 24646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "260c8ff9a4fa4b5182db08c581b09a4a"
format_stamp: "Formatted at 2026-08-10 18:36:15 on dist-test-slave-5k54"
server_key: "565a086696371135c7339f40afaeabfa"
server_key_iv: "7639925d53d3ee6a52105f55a94300e3"
server_key_version: "encryptionkey@0"
I20260810 18:36:15.930506 24646 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260810 18:36:15.933861 24662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:15.935139 24646 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:36:15.935310 24646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "260c8ff9a4fa4b5182db08c581b09a4a"
format_stamp: "Formatted at 2026-08-10 18:36:15 on dist-test-slave-5k54"
server_key: "565a086696371135c7339f40afaeabfa"
server_key_iv: "7639925d53d3ee6a52105f55a94300e3"
server_key_version: "encryptionkey@0"
I20260810 18:36:15.935581 24646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:15.950510 24646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:15.951282 24646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:15.951644 24646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:15.952527 24646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:15.953945 24646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:15.954067 24646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:15.954205 24646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:15.954293 24646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:15.989564 24646 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:38617
I20260810 18:36:15.989617 24788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:38617 every 8 connection(s)
I20260810 18:36:15.990803 24646 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:36:15.992350 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 24646
I20260810 18:36:15.992532 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:36:15.993163 13868 external_mini_cluster.cc:1428] Setting key 7c70224cbc1d3b1fed19b56a858481d0
I20260810 18:36:16.002902 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:15.993484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:56735 (local address 127.13.139.62:45943)
0810 18:36:15.993654 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:15.993658 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:15.995232 (+ 1574us) server_negotiation.cc:407] Connection header received
0810 18:36:15.997092 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:15.997096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:15.997170 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:15.997251 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:15.998250 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.998948 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.000505 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.000922 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.001017 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:16.002235 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:16.002239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:16.002243 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:16.002260 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:16.002291 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:16.002302 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:16.002372 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:16.002563 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 18:36:16.002640 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:36:16.003947 24791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:15.994078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:45943 (local address 127.13.139.3:56735)
0810 18:36:15.995085 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:15.995127 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:15.996850 (+ 1723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:15.997451 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:15.997459 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:15.997549 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:15.998117 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:15.998134 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:15.999082 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:15.999086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:16.000372 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:16.000385 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.001105 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.001110 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:16.001309 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:16.001952 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:36:16.001955 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:16.001993 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:36:16.002065 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:16.002388 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:16.002395 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:16.002401 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 18:36:16.002537 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 18:36:16.002841 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":331,"threads_started":1}
I20260810 18:36:16.005250 24789 heartbeater.cc:347] Connected to a master server at 127.13.139.62:45943
I20260810 18:36:16.005563 24789 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:16.006349 24789 heartbeater.cc:511] Master 127.13.139.62:45943 requested a full tablet report, sending...
I20260810 18:36:16.007973 24289 ts_manager.cc:194] Registered new tserver with Master: 260c8ff9a4fa4b5182db08c581b09a4a (127.13.139.3:38617)
I20260810 18:36:16.008728 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:36:16.009043 24289 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.3:56735
W20260810 18:36:16.015410 24644 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:16.013836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36140 (local address 127.13.139.62:45943)
0810 18:36:16.013989 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:16.013994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:16.014500 (+ 506us) server_negotiation.cc:407] Connection header received
0810 18:36:16.014637 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:16.014641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:16.014696 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:16.014777 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:16.015116 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36140: BlockingRecv error: recv got EOF from 127.0.0.1:36140 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 18:36:16.016233 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24357
I20260810 18:36:16.023905 24798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:16.017345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34512 (local address 127.13.139.1:32915)
0810 18:36:16.017852 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:16.017859 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:16.017882 (+ 23us) server_negotiation.cc:407] Connection header received
0810 18:36:16.017934 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:16.017947 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:16.018126 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:16.018254 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:16.018621 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.019684 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.020906 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.021440 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.021533 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:16.022540 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:16.022548 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:16.022560 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:16.023095 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:16.023137 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:16.023155 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:16.023245 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:16.023375 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 18:36:16.023556 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":277,"threads_started":1}
I20260810 18:36:16.025112 24492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:16.105998 24497 heartbeater.cc:503] Master 127.13.139.62:45943 was elected leader, sending a full tablet report...
I20260810 18:36:16.107167 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 24357
W20260810 18:36:16.129664 24272 connection.cc:535] server connection from 127.13.139.1:55069 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 18:36:16.129951 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24502
I20260810 18:36:16.137967 24800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:16.130832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57054 (local address 127.13.139.2:45917)
0810 18:36:16.131367 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:16.131374 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:16.131406 (+ 32us) server_negotiation.cc:407] Connection header received
0810 18:36:16.131549 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:16.131556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:16.131784 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:16.131962 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:16.132427 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.133369 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.134646 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.135198 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.135339 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:16.136525 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:16.136533 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:16.136546 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:16.137117 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:16.137174 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:16.137193 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:16.137320 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:16.137479 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 18:36:16.137616 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":282,"threads_started":1}
I20260810 18:36:16.139242 24637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:16.221443 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 24502
I20260810 18:36:16.240703 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24646
I20260810 18:36:16.249107 24802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:16.241751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35616 (local address 127.13.139.3:38617)
0810 18:36:16.242456 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:16.242463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:16.242493 (+ 30us) server_negotiation.cc:407] Connection header received
0810 18:36:16.242555 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:16.242562 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:16.242772 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:16.242901 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:16.243272 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.244596 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.245789 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:16.246328 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:16.246425 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:16.247409 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:16.247418 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:16.247593 (+ 175us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:16.248240 (+ 647us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:16.248294 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:16.248314 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:16.248457 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:16.248534 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 18:36:16.248674 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":401,"threads_started":1}
I20260810 18:36:16.250348 24783 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:16.333186 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 24646
I20260810 18:36:16.352047 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24255
I20260810 18:36:16.353266 24321 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:16.455189 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 24255
2026-08-10T18:36:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2868 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T18:36:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:36:16Z Disabled control of system clock
I20260810 18:36:16.539170 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:35811
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:33489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:35811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 18:36:16.874396 24809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:16.874848 24809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:16.875018 24809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:16.882820 24809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:36:16.882936 24809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:16.882977 24809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:16.883029 24809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:36:16.883144 24809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:36:16.892622 24809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:35811
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:35811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:16.893971 24809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:16.895865 24809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:16.908196 24817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:16.908269 24815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:16.908469 24814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:16.909345 24809 server_base.cc:1034] running on GCE node
I20260810 18:36:16.910138 24809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:16.911590 24809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:16.912833 24809 hybrid_clock.cc:648] HybridClock initialized: now 1786386976912777 us; error 47 us; skew 500 ppm
I20260810 18:36:16.913231 24809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:16.915500 24809 webserver.cc:460] Webserver started at http://127.13.139.62:41449/ using document root <none> and password file <none>
I20260810 18:36:16.916199 24809 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:16.916344 24809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:16.916687 24809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:16.919621 24809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "bda129a1813542fc8731a2bbd6adea1a"
format_stamp: "Formatted at 2026-08-10 18:36:16 on dist-test-slave-5k54"
server_key: "8f29a665678043928c7e2e835a829b6e"
server_key_iv: "1b82d7b18df2b8407aabbdbeb759cb97"
server_key_version: "encryptionkey@0"
I20260810 18:36:16.920419 24809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "bda129a1813542fc8731a2bbd6adea1a"
format_stamp: "Formatted at 2026-08-10 18:36:16 on dist-test-slave-5k54"
server_key: "8f29a665678043928c7e2e835a829b6e"
server_key_iv: "1b82d7b18df2b8407aabbdbeb759cb97"
server_key_version: "encryptionkey@0"
I20260810 18:36:16.925390 24809 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260810 18:36:16.928725 24823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:16.929948 24809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:36:16.930130 24809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "bda129a1813542fc8731a2bbd6adea1a"
format_stamp: "Formatted at 2026-08-10 18:36:16 on dist-test-slave-5k54"
server_key: "8f29a665678043928c7e2e835a829b6e"
server_key_iv: "1b82d7b18df2b8407aabbdbeb759cb97"
server_key_version: "encryptionkey@0"
I20260810 18:36:16.930378 24809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:16.935978 24809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:16.936710 24809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:16.937008 24809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:16.955183 24809 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:35811
I20260810 18:36:16.955224 24878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:35811 every 8 connection(s)
I20260810 18:36:16.956523 24809 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:36:16.960194 24879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:36:16.962924 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 24809
I20260810 18:36:16.963174 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:36:16.964056 13868 external_mini_cluster.cc:1428] Setting key a5038c4f4daa69b8a65404a970a8b144
I20260810 18:36:16.972412 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:16.966181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52100 (local address 127.13.139.62:35811)
0810 18:36:16.967171 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:16.967182 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:16.967221 (+ 39us) server_negotiation.cc:407] Connection header received
0810 18:36:16.968895 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:16.968921 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:16.969326 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:16.969649 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:16.970757 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:16.970763 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:16.970775 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:16.970788 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:16.970845 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:16.970860 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:16.971067 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:16.971165 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 18:36:16.971429 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":378,"threads_started":1}
I20260810 18:36:16.972939 24879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a: Bootstrap starting.
I20260810 18:36:16.975842 24879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a: Neither blocks nor log segments found. Creating new log.
I20260810 18:36:16.976809 24879 log.cc:824] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a: Log is configured to *not* fsync() on all Append() calls
I20260810 18:36:16.979264 24879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a: No bootstrap required, opened a new log
I20260810 18:36:16.986243 24879 raft_consensus.cc:348] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda129a1813542fc8731a2bbd6adea1a" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35811 } }
I20260810 18:36:16.986624 24879 raft_consensus.cc:374] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:36:16.986728 24879 raft_consensus.cc:729] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda129a1813542fc8731a2bbd6adea1a, State: Initialized, Role: FOLLOWER
I20260810 18:36:16.987284 24879 consensus_queue.cc:260] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda129a1813542fc8731a2bbd6adea1a" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35811 } }
I20260810 18:36:16.987568 24879 raft_consensus.cc:388] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:36:16.987716 24879 raft_consensus.cc:482] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:36:16.987880 24879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:36:16.989939 24879 raft_consensus.cc:504] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda129a1813542fc8731a2bbd6adea1a" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35811 } }
I20260810 18:36:16.990419 24879 leader_election.cc:302] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bda129a1813542fc8731a2bbd6adea1a; no voters:
I20260810 18:36:16.991060 24879 leader_election.cc:288] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:36:16.991206 24884 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:36:16.992102 24884 raft_consensus.cc:686] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [term 1 LEADER]: Becoming Leader. State: Replica: bda129a1813542fc8731a2bbd6adea1a, State: Running, Role: LEADER
I20260810 18:36:16.992718 24884 consensus_queue.cc:237] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda129a1813542fc8731a2bbd6adea1a" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35811 } }
I20260810 18:36:16.993136 24879 sys_catalog.cc:564] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:36:17.000344 24885 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bda129a1813542fc8731a2bbd6adea1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda129a1813542fc8731a2bbd6adea1a" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35811 } } }
I20260810 18:36:17.000736 24885 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [sys.catalog]: This master's current role is: LEADER
I20260810 18:36:17.000417 24886 sys_catalog.cc:455] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bda129a1813542fc8731a2bbd6adea1a. Latest consensus state: current_term: 1 leader_uuid: "bda129a1813542fc8731a2bbd6adea1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bda129a1813542fc8731a2bbd6adea1a" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35811 } } }
I20260810 18:36:17.000910 24886 sys_catalog.cc:458] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a [sys.catalog]: This master's current role is: LEADER
W20260810 18:36:17.006541 24901 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:36:17.006669 24901 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:36:17.006845 24902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:36:17.008674 24902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:36:17.017028 24902 catalog_manager.cc:1347] Generated new cluster ID: 3c8a9bfffa004265ab700654e4971604
I20260810 18:36:17.017146 24902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:36:17.039338 24902 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:36:17.039801 24902 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:36:17.050518 24902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bda129a1813542fc8731a2bbd6adea1a: Generated new TSK 0
I20260810 18:36:17.051294 24902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:36:17.058352 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35811
--builtin_ntp_servers=127.13.139.20:33489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 18:36:17.394645 24907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:17.394958 24907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:17.395141 24907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:17.402464 24907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:17.402565 24907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:17.402740 24907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:36:17.411936 24907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35811
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:17.413300 24907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:17.415091 24907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:17.428148 24914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:17.428100 24916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:17.428725 24913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:17.429201 24907 server_base.cc:1034] running on GCE node
I20260810 18:36:17.429749 24907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:17.430642 24907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:17.431843 24907 hybrid_clock.cc:648] HybridClock initialized: now 1786386977431806 us; error 28 us; skew 500 ppm
I20260810 18:36:17.432139 24907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:17.434602 24907 webserver.cc:460] Webserver started at http://127.13.139.1:33445/ using document root <none> and password file <none>
I20260810 18:36:17.435348 24907 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:17.435505 24907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:17.435797 24907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:17.438575 24907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "ad98ec290e75489e9a40fb448ee7b960"
format_stamp: "Formatted at 2026-08-10 18:36:17 on dist-test-slave-5k54"
server_key: "21607afe2d435ce8bea76746d2e3bc64"
server_key_iv: "e7b2d1a7dc7c79293860929f119e08ea"
server_key_version: "encryptionkey@0"
I20260810 18:36:17.439324 24907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "ad98ec290e75489e9a40fb448ee7b960"
format_stamp: "Formatted at 2026-08-10 18:36:17 on dist-test-slave-5k54"
server_key: "21607afe2d435ce8bea76746d2e3bc64"
server_key_iv: "e7b2d1a7dc7c79293860929f119e08ea"
server_key_version: "encryptionkey@0"
I20260810 18:36:17.444453 24907 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260810 18:36:17.447764 24924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:17.449071 24907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:36:17.449239 24907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "ad98ec290e75489e9a40fb448ee7b960"
format_stamp: "Formatted at 2026-08-10 18:36:17 on dist-test-slave-5k54"
server_key: "21607afe2d435ce8bea76746d2e3bc64"
server_key_iv: "e7b2d1a7dc7c79293860929f119e08ea"
server_key_version: "encryptionkey@0"
I20260810 18:36:17.449460 24907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:17.455144 24907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:17.456009 24907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:17.456288 24907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:17.457206 24907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:17.458585 24907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:17.458699 24907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:17.458825 24907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:17.458926 24907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:17.492465 24907 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:40629
I20260810 18:36:17.492556 25045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:40629 every 8 connection(s)
I20260810 18:36:17.493875 24907 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:36:17.497119 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 24907
I20260810 18:36:17.497390 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:36:17.498172 13868 external_mini_cluster.cc:1428] Setting key 0b4a50d4076976c2948d4d6cf8c9964e
I20260810 18:36:17.501199 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35811
--builtin_ntp_servers=127.13.139.20:33489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 18:36:17.504987 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:17.496560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:46969 (local address 127.13.139.62:35811)
0810 18:36:17.497131 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:17.497139 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:17.500513 (+ 3374us) server_negotiation.cc:407] Connection header received
0810 18:36:17.502431 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:17.502447 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:17.502524 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:17.502650 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:17.504141 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:17.504149 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:17.504156 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:17.504180 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:17.504235 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:17.504254 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:17.504382 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:17.504548 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 18:36:17.504617 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":254,"threads_started":1}
I20260810 18:36:17.505810 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:17.497220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35811 (local address 127.13.139.1:46969)
0810 18:36:17.500326 (+ 3106us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:17.500379 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:17.502093 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:17.502899 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:17.502907 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:17.503002 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:17.503791 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:36:17.503793 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:17.503869 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:36:17.503962 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:17.504355 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:17.504363 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:17.504369 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 18:36:17.504581 (+ 212us) client_negotiation.cc:240] Negotiation successful
0810 18:36:17.504802 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2531,"thread_start_us":2305,"threads_started":1}
I20260810 18:36:17.507365 25046 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35811
I20260810 18:36:17.507715 25046 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:17.508410 25046 heartbeater.cc:511] Master 127.13.139.62:35811 requested a full tablet report, sending...
I20260810 18:36:17.510743 24841 ts_manager.cc:194] Registered new tserver with Master: ad98ec290e75489e9a40fb448ee7b960 (127.13.139.1:40629)
W20260810 18:36:17.830629 25050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:17.830940 25050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:17.831100 25050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:17.838297 25050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:17.838434 25050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:17.838610 25050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:36:17.847647 25050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35811
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:17.848908 25050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:17.850689 25050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:17.863634 25056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:17.863726 25057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:17.863687 25059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:17.864825 25050 server_base.cc:1034] running on GCE node
I20260810 18:36:17.865460 25050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:17.866353 25050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:17.867563 25050 hybrid_clock.cc:648] HybridClock initialized: now 1786386977867525 us; error 57 us; skew 500 ppm
I20260810 18:36:17.867871 25050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:17.870182 25050 webserver.cc:460] Webserver started at http://127.13.139.2:38575/ using document root <none> and password file <none>
I20260810 18:36:17.870815 25050 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:17.870904 25050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:17.871173 25050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:17.873899 25050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "453318fdbcd74f62ac4d8dab758c281b"
format_stamp: "Formatted at 2026-08-10 18:36:17 on dist-test-slave-5k54"
server_key: "a296af33843f0a2d3b3e083a46f8b48c"
server_key_iv: "f9d096a5c97ffa31cb1ea71969a73ab6"
server_key_version: "encryptionkey@0"
I20260810 18:36:17.874713 25050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "453318fdbcd74f62ac4d8dab758c281b"
format_stamp: "Formatted at 2026-08-10 18:36:17 on dist-test-slave-5k54"
server_key: "a296af33843f0a2d3b3e083a46f8b48c"
server_key_iv: "f9d096a5c97ffa31cb1ea71969a73ab6"
server_key_version: "encryptionkey@0"
I20260810 18:36:17.879673 25050 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260810 18:36:17.882977 25066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:17.884289 25050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:36:17.884455 25050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "453318fdbcd74f62ac4d8dab758c281b"
format_stamp: "Formatted at 2026-08-10 18:36:17 on dist-test-slave-5k54"
server_key: "a296af33843f0a2d3b3e083a46f8b48c"
server_key_iv: "f9d096a5c97ffa31cb1ea71969a73ab6"
server_key_version: "encryptionkey@0"
I20260810 18:36:17.884667 25050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:17.890339 25050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:17.891090 25050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:17.891360 25050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:17.892278 25050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:17.893709 25050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:17.893822 25050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:17.893960 25050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:17.894044 25050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:17.927223 25050 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:42907
I20260810 18:36:17.927282 25184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:42907 every 8 connection(s)
I20260810 18:36:17.928627 25050 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:36:17.929665 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 25050
I20260810 18:36:17.929877 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:36:17.930442 13868 external_mini_cluster.cc:1428] Setting key 88bc8519ae152007111422106cd29ea6
I20260810 18:36:17.933799 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35811
--builtin_ntp_servers=127.13.139.20:33489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 18:36:17.938923 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:17.931685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:45009 (local address 127.13.139.62:35811)
0810 18:36:17.931881 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:17.931888 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:17.933657 (+ 1769us) server_negotiation.cc:407] Connection header received
0810 18:36:17.936474 (+ 2817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:17.936482 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:17.936560 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:17.936657 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:17.938132 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:17.938140 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:17.938147 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:17.938167 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:17.938205 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:17.938220 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:17.938329 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:17.938541 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 18:36:17.938603 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:36:17.940126 25188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:17.932271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35811 (local address 127.13.139.2:45009)
0810 18:36:17.933498 (+ 1227us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:17.933547 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:17.936160 (+ 2613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:17.936915 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:17.936929 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:17.937046 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:17.937780 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:36:17.937785 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:17.937835 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:36:17.937956 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:17.938320 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:17.938331 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:17.938342 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 18:36:17.938614 (+ 272us) client_negotiation.cc:240] Negotiation successful
0810 18:36:17.938860 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":359,"threads_started":1}
I20260810 18:36:17.944667 25186 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35811
I20260810 18:36:17.944977 25186 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:17.945698 25186 heartbeater.cc:511] Master 127.13.139.62:35811 requested a full tablet report, sending...
I20260810 18:36:17.947211 24841 ts_manager.cc:194] Registered new tserver with Master: 453318fdbcd74f62ac4d8dab758c281b (127.13.139.2:42907)
W20260810 18:36:18.270563 25189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:18.270896 25189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:18.271063 25189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:18.278426 25189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:18.278568 25189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:18.278744 25189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:36:18.287958 25189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:33489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35811
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:18.289467 25189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:18.291253 25189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:18.305480 25197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:18.305614 25195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:18.305711 25194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:18.306790 25189 server_base.cc:1034] running on GCE node
I20260810 18:36:18.307533 25189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:18.308491 25189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:18.309684 25189 hybrid_clock.cc:648] HybridClock initialized: now 1786386978309619 us; error 66 us; skew 500 ppm
I20260810 18:36:18.309989 25189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:36:18.312427 25189 webserver.cc:460] Webserver started at http://127.13.139.3:42583/ using document root <none> and password file <none>
I20260810 18:36:18.313107 25189 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:18.313215 25189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:18.313557 25189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:18.316427 25189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "81bd57a0108e48cb84a60a25a78e0bd0"
format_stamp: "Formatted at 2026-08-10 18:36:18 on dist-test-slave-5k54"
server_key: "e73dfb5a5e5160b6b776095c3d986924"
server_key_iv: "1e4d679457c5bda3e74d066dc7266b97"
server_key_version: "encryptionkey@0"
I20260810 18:36:18.317230 25189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "81bd57a0108e48cb84a60a25a78e0bd0"
format_stamp: "Formatted at 2026-08-10 18:36:18 on dist-test-slave-5k54"
server_key: "e73dfb5a5e5160b6b776095c3d986924"
server_key_iv: "1e4d679457c5bda3e74d066dc7266b97"
server_key_version: "encryptionkey@0"
I20260810 18:36:18.322367 25189 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260810 18:36:18.325798 25205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:18.327127 25189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:36:18.327306 25189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "81bd57a0108e48cb84a60a25a78e0bd0"
format_stamp: "Formatted at 2026-08-10 18:36:18 on dist-test-slave-5k54"
server_key: "e73dfb5a5e5160b6b776095c3d986924"
server_key_iv: "1e4d679457c5bda3e74d066dc7266b97"
server_key_version: "encryptionkey@0"
I20260810 18:36:18.327605 25189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:18.333168 25189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:18.333989 25189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:18.334326 25189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:18.335286 25189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:18.336779 25189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:18.336901 25189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:18.337037 25189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:18.337124 25189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:18.370529 25189 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:40769
I20260810 18:36:18.370587 25329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:40769 every 8 connection(s)
I20260810 18:36:18.371867 25189 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:36:18.373479 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 25189
I20260810 18:36:18.373679 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:36:18.374123 13868 external_mini_cluster.cc:1428] Setting key cd17d170747b4a9c9d5c237617b2430e
I20260810 18:36:18.381060 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:18.374618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:33237 (local address 127.13.139.62:35811)
0810 18:36:18.374793 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:18.374797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:18.376722 (+ 1925us) server_negotiation.cc:407] Connection header received
0810 18:36:18.378711 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:18.378716 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:18.378786 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:18.378905 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:18.380289 (+ 1384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:18.380295 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:18.380300 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:18.380319 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:18.380359 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:18.380371 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:18.380490 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:18.380698 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 18:36:18.380770 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 18:36:18.382097 25332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:18.375346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35811 (local address 127.13.139.3:33237)
0810 18:36:18.376580 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:18.376618 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:18.378458 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:18.379134 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:18.379142 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:18.379229 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:18.379993 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:36:18.379996 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:18.380033 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:36:18.380116 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:18.380470 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:18.380481 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:18.380489 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 18:36:18.380792 (+ 303us) client_negotiation.cc:240] Negotiation successful
0810 18:36:18.381031 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":368,"threads_started":1}
I20260810 18:36:18.384109 25330 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35811
I20260810 18:36:18.384379 25330 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:18.384949 25330 heartbeater.cc:511] Master 127.13.139.62:35811 requested a full tablet report, sending...
I20260810 18:36:18.386250 24841 ts_manager.cc:194] Registered new tserver with Master: 81bd57a0108e48cb84a60a25a78e0bd0 (127.13.139.3:40769)
I20260810 18:36:18.389840 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 18:36:18.396096 25048 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:36:18.394460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52112 (local address 127.13.139.62:35811)
0810 18:36:18.394663 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:18.394673 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:18.395161 (+ 488us) server_negotiation.cc:407] Connection header received
0810 18:36:18.395291 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:18.395295 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:18.395359 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:18.395523 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:18.395857 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52112: BlockingRecv error: recv got EOF from 127.0.0.1:52112 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:36:18.396476 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24907
I20260810 18:36:18.400202 25339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:18.397467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50988 (local address 127.13.139.1:40629)
0810 18:36:18.398103 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:18.398110 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:18.398136 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:36:18.398193 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:18.398199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:18.398400 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:18.398527 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:18.399466 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:18.399477 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:18.399498 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:18.399521 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:18.399570 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:18.399585 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:18.399699 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:18.399791 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 18:36:18.399892 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":281,"threads_started":1}
I20260810 18:36:18.401427 25040 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:18.483847 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 24907
I20260810 18:36:18.503512 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 25050
I20260810 18:36:18.507177 25343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:18.504525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34620 (local address 127.13.139.2:42907)
0810 18:36:18.505077 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:18.505084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:18.505111 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:36:18.505172 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:18.505178 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:18.505389 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:18.505534 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:18.506475 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:18.506482 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:18.506492 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:18.506511 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:18.506556 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:18.506570 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:18.506678 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:18.506754 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 18:36:18.506864 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":292,"threads_started":1}
I20260810 18:36:18.508503 25180 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:18.589401 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 25050
I20260810 18:36:18.608469 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 25189
I20260810 18:36:18.612408 25345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:18.609348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36672 (local address 127.13.139.3:40769)
0810 18:36:18.609935 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:18.609943 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:18.609975 (+ 32us) server_negotiation.cc:407] Connection header received
0810 18:36:18.610039 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:18.610045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:18.610257 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:18.610429 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:18.611659 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:18.611665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:18.611676 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:36:18.611688 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:18.611731 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:36:18.611744 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:18.611930 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:18.612009 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 18:36:18.612111 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":270,"threads_started":1}
I20260810 18:36:18.613608 25325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:18.697022 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 25189
I20260810 18:36:18.717075 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 24809
I20260810 18:36:18.718283 24873 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:18.822947 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 24809
2026-08-10T18:36:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2368 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:36:18 dist-test-slave-5k54 krb5kdc[25350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:36:18 dist-test-slave-5k54 krb5kdc[25350](info): set up 2 sockets
Aug 10 18:36:18 dist-test-slave-5k54 krb5kdc[25350](info): commencing operation
krb5kdc: starting...
W20260810 18:36:20.055652 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:36:20 dist-test-slave-5k54 krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:36:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:36:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:36:20.334878 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:35633
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:35633
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:36:20.674511 25364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:20.674772 25364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:20.674907 25364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:20.682120 25364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:36:20.682219 25364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:20.682318 25364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:20.682435 25364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:36:20.682521 25364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:36:20.692476 25364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:35633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:35633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:20.693774 25364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:20.695127 25364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:20.707553 25370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:20.707666 25372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:20.707589 25369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:20.708760 25364 server_base.cc:1034] running on GCE node
I20260810 18:36:20.709636 25364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:20.711081 25364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:20.712318 25364 hybrid_clock.cc:648] HybridClock initialized: now 1786386980712262 us; error 36 us; skew 500 ppm
I20260810 18:36:20.712683 25364 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:36:20 dist-test-slave-5k54 krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386980, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:36:20.715831 25364 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:36:20.717199 25364 webserver.cc:460] Webserver started at http://127.13.139.62:39277/ using document root <none> and password file <none>
I20260810 18:36:20.717830 25364 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:20.717929 25364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:20.718199 25364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:20.721190 25364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "6e2b1467116147b48403d37766d86993"
format_stamp: "Formatted at 2026-08-10 18:36:20 on dist-test-slave-5k54"
server_key: "90609a0042186d124133720d4709ca0c"
server_key_iv: "df6565dd6f7b70297b96f9f5ef148cc6"
server_key_version: "encryptionkey@0"
I20260810 18:36:20.721920 25364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "6e2b1467116147b48403d37766d86993"
format_stamp: "Formatted at 2026-08-10 18:36:20 on dist-test-slave-5k54"
server_key: "90609a0042186d124133720d4709ca0c"
server_key_iv: "df6565dd6f7b70297b96f9f5ef148cc6"
server_key_version: "encryptionkey@0"
I20260810 18:36:20.726992 25364 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:36:20.730479 25380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:20.732012 25364 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:36:20.732195 25364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "6e2b1467116147b48403d37766d86993"
format_stamp: "Formatted at 2026-08-10 18:36:20 on dist-test-slave-5k54"
server_key: "90609a0042186d124133720d4709ca0c"
server_key_iv: "df6565dd6f7b70297b96f9f5ef148cc6"
server_key_version: "encryptionkey@0"
I20260810 18:36:20.732400 25364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:20.752668 25364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:20.756755 25364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:20.757058 25364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:20.775707 25364 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:35633
I20260810 18:36:20.775749 25437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:35633 every 8 connection(s)
I20260810 18:36:20.777068 25364 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:36:20.780747 25438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:36:20.782603 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 25364
I20260810 18:36:20.782855 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:36:20.783726 13868 external_mini_cluster.cc:1428] Setting key ba4ab02a683247386b1958276d23e026
I20260810 18:36:20.793704 25438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993: Bootstrap starting.
I20260810 18:36:20.797629 25438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993: Neither blocks nor log segments found. Creating new log.
Aug 10 18:36:20 dist-test-slave-5k54 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:36:20.798841 25438 log.cc:824] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993: Log is configured to *not* fsync() on all Append() calls
I20260810 18:36:20.801777 25438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993: No bootstrap required, opened a new log
I20260810 18:36:20.806985 25441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:20.785843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50440 (local address 127.13.139.62:35633)
0810 18:36:20.786664 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:20.786675 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:20.786719 (+ 44us) server_negotiation.cc:407] Connection header received
0810 18:36:20.788514 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:20.788534 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:20.788905 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:20.789220 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:20.791012 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:20.792428 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:20.794194 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:20.794840 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:20.794983 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:20.799752 (+ 4769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:20.799760 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:20.799777 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:20.799813 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:20.802908 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:20.803655 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:20.803662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:20.803668 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:20.803839 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:20.804238 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:20.804243 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:20.804246 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:20.804797 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:20.805146 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:20.805575 (+ 429us) server_negotiation.cc:299] Negotiation successful
0810 18:36:20.805999 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":393,"threads_started":1}
I20260810 18:36:20.809762 25438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e2b1467116147b48403d37766d86993" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35633 } }
I20260810 18:36:20.810187 25438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:36:20.810294 25438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e2b1467116147b48403d37766d86993, State: Initialized, Role: FOLLOWER
I20260810 18:36:20.810905 25438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e2b1467116147b48403d37766d86993" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35633 } }
I20260810 18:36:20.811134 25438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:36:20.811283 25438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:36:20.811481 25438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:36:20.813717 25438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e2b1467116147b48403d37766d86993" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35633 } }
I20260810 18:36:20.814237 25438 leader_election.cc:302] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e2b1467116147b48403d37766d86993; no voters:
I20260810 18:36:20.814978 25438 leader_election.cc:288] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:36:20.815119 25444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:36:20.815788 25444 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [term 1 LEADER]: Becoming Leader. State: Replica: 6e2b1467116147b48403d37766d86993, State: Running, Role: LEADER
I20260810 18:36:20.816429 25444 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e2b1467116147b48403d37766d86993" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35633 } }
I20260810 18:36:20.817373 25438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:36:20.819353 25445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e2b1467116147b48403d37766d86993. Latest consensus state: current_term: 1 leader_uuid: "6e2b1467116147b48403d37766d86993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e2b1467116147b48403d37766d86993" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35633 } } }
I20260810 18:36:20.819568 25446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e2b1467116147b48403d37766d86993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e2b1467116147b48403d37766d86993" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 35633 } } }
I20260810 18:36:20.819990 25445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [sys.catalog]: This master's current role is: LEADER
I20260810 18:36:20.819996 25446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993 [sys.catalog]: This master's current role is: LEADER
I20260810 18:36:20.821753 25451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:36:20.827009 25451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:36:20.837999 25451 catalog_manager.cc:1347] Generated new cluster ID: 159b64632d624422816dc8eba8de1c73
I20260810 18:36:20.838130 25451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:36:20.855859 25451 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:36:20.857137 25451 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:36:20.864540 25451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993: Generated new TSK 0
I20260810 18:36:20.865329 25451 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:36:20.947856 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35633
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:36:21.296316 25465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:21.296605 25465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:21.296701 25465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:21.303944 25465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:21.304057 25465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:21.304167 25465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:36:21.314116 25465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35633
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:21.315346 25465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:21.316658 25465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:21.329936 25470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:21.330173 25472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:21.330210 25474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:21.331123 25465 server_base.cc:1034] running on GCE node
I20260810 18:36:21.331771 25465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:21.332675 25465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:21.333873 25465 hybrid_clock.cc:648] HybridClock initialized: now 1786386981333837 us; error 28 us; skew 500 ppm
I20260810 18:36:21.334167 25465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:36:21 dist-test-slave-5k54 krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386981, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:36:21.337577 25465 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:36:21.339066 25465 webserver.cc:460] Webserver started at http://127.13.139.1:39797/ using document root <none> and password file <none>
I20260810 18:36:21.339824 25465 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:21.339972 25465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:21.340278 25465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:21.343122 25465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "6e8e7a07cac544d3a0b7024b0e599b3d"
format_stamp: "Formatted at 2026-08-10 18:36:21 on dist-test-slave-5k54"
server_key: "3fdd43255c8ff18c6f265e6ca12e36cc"
server_key_iv: "48fa3c2062d1f9e052c80452cff1ddb7"
server_key_version: "encryptionkey@0"
I20260810 18:36:21.343888 25465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "6e8e7a07cac544d3a0b7024b0e599b3d"
format_stamp: "Formatted at 2026-08-10 18:36:21 on dist-test-slave-5k54"
server_key: "3fdd43255c8ff18c6f265e6ca12e36cc"
server_key_iv: "48fa3c2062d1f9e052c80452cff1ddb7"
server_key_version: "encryptionkey@0"
I20260810 18:36:21.348739 25465 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 18:36:21.352022 25484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:21.353261 25465 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:36:21.353434 25465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "6e8e7a07cac544d3a0b7024b0e599b3d"
format_stamp: "Formatted at 2026-08-10 18:36:21 on dist-test-slave-5k54"
server_key: "3fdd43255c8ff18c6f265e6ca12e36cc"
server_key_iv: "48fa3c2062d1f9e052c80452cff1ddb7"
server_key_version: "encryptionkey@0"
I20260810 18:36:21.353634 25465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:21.366147 25465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:21.369798 25465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:21.370086 25465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:21.370966 25465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:21.372316 25465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:21.372427 25465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:21.372572 25465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:21.372650 25465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:21.405879 25465 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:41451
I20260810 18:36:21.405925 25607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:41451 every 8 connection(s)
I20260810 18:36:21.407148 25465 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:36:21.410434 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 25465
I20260810 18:36:21.410705 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:36:21.411556 13868 external_mini_cluster.cc:1428] Setting key 15f7690f76a5dba6450c74468b041ce6
Aug 10 18:36:21 dist-test-slave-5k54 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386981, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:36:21.428782 25610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:21.409667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:49095 (local address 127.13.139.62:35633)
0810 18:36:21.410147 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:21.410152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:21.411155 (+ 1003us) server_negotiation.cc:407] Connection header received
0810 18:36:21.413340 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:21.413349 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:21.413444 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:21.413543 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:21.415045 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.416242 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.417862 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.418557 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.418698 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:21.422249 (+ 3551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:21.422257 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:21.422265 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:21.422312 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:21.425600 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:21.426542 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:21.426546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:21.426548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:21.426655 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:21.427129 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:21.427132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:21.427134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:21.427370 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:21.427551 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:21.428371 (+ 820us) server_negotiation.cc:299] Negotiation successful
0810 18:36:21.428526 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":269,"threads_started":1}
I20260810 18:36:21.430297 25611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:21.410134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35633 (local address 127.13.139.1:49095)
0810 18:36:21.411000 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:21.411039 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:21.413049 (+ 2010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:21.413804 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:21.413811 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:21.414294 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:21.414851 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:21.414869 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.416393 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.416396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:21.417719 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:21.417731 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.418754 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.418759 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:21.418950 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:21.419700 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:21.419721 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:21.422007 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:21.425744 (+ 3737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:36:21.425755 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:36:21.425772 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:36:21.426431 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:36:21.426758 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:36:21.426765 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:36:21.426771 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:36:21.427024 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:36:21.427544 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:21.427554 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:21.427995 (+ 441us) client_negotiation.cc:769] Sending connection context
0810 18:36:21.428297 (+ 302us) client_negotiation.cc:240] Negotiation successful
0810 18:36:21.428868 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":380,"threads_started":1}
I20260810 18:36:21.431929 25608 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35633
I20260810 18:36:21.432248 25608 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:21.432972 25608 heartbeater.cc:511] Master 127.13.139.62:35633 requested a full tablet report, sending...
I20260810 18:36:21.435112 25399 ts_manager.cc:194] Registered new tserver with Master: 6e8e7a07cac544d3a0b7024b0e599b3d (127.13.139.1:41451)
I20260810 18:36:21.436880 25399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:49095
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:36:21.475258 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35633
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:36:21.815990 25614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:21.816313 25614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:21.816481 25614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:21.824003 25614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:21.824153 25614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:21.824321 25614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:36:21.834192 25614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35633
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:21.835656 25614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:21.837124 25614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:21.850692 25623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:21.850723 25620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:21.851140 25619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:21.851912 25614 server_base.cc:1034] running on GCE node
I20260810 18:36:21.852509 25614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:21.853432 25614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:21.854658 25614 hybrid_clock.cc:648] HybridClock initialized: now 1786386981854623 us; error 51 us; skew 500 ppm
I20260810 18:36:21.855012 25614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:36:21 dist-test-slave-5k54 krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386981, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:36:21.858349 25614 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:36:21.859807 25614 webserver.cc:460] Webserver started at http://127.13.139.2:39771/ using document root <none> and password file <none>
I20260810 18:36:21.860451 25614 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:21.860553 25614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:21.860796 25614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:21.863736 25614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "7be39436a32e46b4974bb30975e75421"
format_stamp: "Formatted at 2026-08-10 18:36:21 on dist-test-slave-5k54"
server_key: "d1d7ee1e1217bce0134591fdef5849cd"
server_key_iv: "f728ba1c18f34975fdf6bd96c119a740"
server_key_version: "encryptionkey@0"
I20260810 18:36:21.864511 25614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "7be39436a32e46b4974bb30975e75421"
format_stamp: "Formatted at 2026-08-10 18:36:21 on dist-test-slave-5k54"
server_key: "d1d7ee1e1217bce0134591fdef5849cd"
server_key_iv: "f728ba1c18f34975fdf6bd96c119a740"
server_key_version: "encryptionkey@0"
I20260810 18:36:21.869884 25614 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260810 18:36:21.873389 25630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:21.874687 25614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:36:21.874855 25614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "7be39436a32e46b4974bb30975e75421"
format_stamp: "Formatted at 2026-08-10 18:36:21 on dist-test-slave-5k54"
server_key: "d1d7ee1e1217bce0134591fdef5849cd"
server_key_iv: "f728ba1c18f34975fdf6bd96c119a740"
server_key_version: "encryptionkey@0"
I20260810 18:36:21.875054 25614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:21.899061 25614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:21.903227 25614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:21.903564 25614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:21.904511 25614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:21.905848 25614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:21.905954 25614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:21.906116 25614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:21.906193 25614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:21.940685 25614 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:39115
I20260810 18:36:21.940735 25755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:39115 every 8 connection(s)
I20260810 18:36:21.941916 25614 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:36:21.942538 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 25614
I20260810 18:36:21.942754 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:36:21.943383 13868 external_mini_cluster.cc:1428] Setting key fbfdc434383d96ca396fbbd7c57263e7
Aug 10 18:36:21 dist-test-slave-5k54 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386981, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:36:21.964392 25758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:21.945038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:42325 (local address 127.13.139.62:35633)
0810 18:36:21.945572 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:21.945580 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:21.946610 (+ 1030us) server_negotiation.cc:407] Connection header received
0810 18:36:21.948686 (+ 2076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:21.948692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:21.948788 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:21.948930 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:21.950504 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.951300 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.953026 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.953502 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.953647 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:21.957969 (+ 4322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:21.957974 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:21.957977 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:21.958009 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:21.960893 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:21.961934 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:21.961938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:21.961940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:21.962058 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:21.962581 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:21.962585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:21.962586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:21.962828 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:21.962934 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:21.963963 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0810 18:36:21.964128 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":238,"threads_started":1}
I20260810 18:36:21.966180 25759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:21.945642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35633 (local address 127.13.139.2:42325)
0810 18:36:21.946455 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:21.946495 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:21.948403 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:21.949172 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:21.949181 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:21.949710 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:21.950309 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:21.950330 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.951500 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.951511 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:21.952845 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:21.952859 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:21.953805 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:21.953827 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:21.954073 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:21.954827 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:21.954851 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:21.957643 (+ 2792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:21.961055 (+ 3412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:36:21.961067 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:36:21.961087 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:36:21.961806 (+ 719us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:36:21.962172 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:36:21.962180 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:36:21.962187 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:36:21.962465 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:36:21.962963 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:21.962975 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:21.963484 (+ 509us) client_negotiation.cc:769] Sending connection context
0810 18:36:21.963885 (+ 401us) client_negotiation.cc:240] Negotiation successful
0810 18:36:21.964524 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":354,"threads_started":1}
I20260810 18:36:21.967756 25756 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35633
I20260810 18:36:21.968088 25756 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:21.968806 25756 heartbeater.cc:511] Master 127.13.139.62:35633 requested a full tablet report, sending...
I20260810 18:36:21.970258 25399 ts_manager.cc:194] Registered new tserver with Master: 7be39436a32e46b4974bb30975e75421 (127.13.139.2:39115)
I20260810 18:36:21.971191 25399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:42325
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:36:22.011605 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35633
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:36:22.342963 25762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:36:22.343226 25762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:36:22.343456 25762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:36:22.350507 25762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:36:22.350641 25762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:36:22.350841 25762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:36:22.360582 25762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:35633
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:36:22.361809 25762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:36:22.363103 25762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:36:22.376195 25771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:22.376183 25773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:36:22.376469 25770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:36:22.376933 25762 server_base.cc:1034] running on GCE node
I20260810 18:36:22.377569 25762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:36:22.378562 25762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:36:22.379755 25762 hybrid_clock.cc:648] HybridClock initialized: now 1786386982379723 us; error 30 us; skew 500 ppm
I20260810 18:36:22.380033 25762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:36:22 dist-test-slave-5k54 krb5kdc[25350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386982, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:36:22.383028 25762 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:36:22.384518 25762 webserver.cc:460] Webserver started at http://127.13.139.3:39965/ using document root <none> and password file <none>
I20260810 18:36:22.385219 25762 fs_manager.cc:359] Metadata directory not provided
I20260810 18:36:22.385353 25762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:36:22.385669 25762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:36:22.388603 25762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "55d186e178b44f94a368da49a4a3dc40"
format_stamp: "Formatted at 2026-08-10 18:36:22 on dist-test-slave-5k54"
server_key: "044928fd21baafd67131ef9a8ca2336c"
server_key_iv: "32a5481995929aad6de140c60d84492f"
server_key_version: "encryptionkey@0"
I20260810 18:36:22.389357 25762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "55d186e178b44f94a368da49a4a3dc40"
format_stamp: "Formatted at 2026-08-10 18:36:22 on dist-test-slave-5k54"
server_key: "044928fd21baafd67131ef9a8ca2336c"
server_key_iv: "32a5481995929aad6de140c60d84492f"
server_key_version: "encryptionkey@0"
I20260810 18:36:22.394564 25762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 18:36:22.397975 25780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:22.399323 25762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:36:22.399538 25762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "55d186e178b44f94a368da49a4a3dc40"
format_stamp: "Formatted at 2026-08-10 18:36:22 on dist-test-slave-5k54"
server_key: "044928fd21baafd67131ef9a8ca2336c"
server_key_iv: "32a5481995929aad6de140c60d84492f"
server_key_version: "encryptionkey@0"
I20260810 18:36:22.399747 25762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:36:22.428745 25762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:36:22.432576 25762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:36:22.432880 25762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:36:22.433919 25762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:36:22.435256 25762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:36:22.435359 25762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:22.435540 25762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:36:22.435618 25762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:36:22.439859 25608 heartbeater.cc:503] Master 127.13.139.62:35633 was elected leader, sending a full tablet report...
I20260810 18:36:22.469976 25762 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:33521
I20260810 18:36:22.470067 25906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:33521 every 8 connection(s)
I20260810 18:36:22.471500 25762 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:36:22.479346 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 25762
I20260810 18:36:22.479602 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:36:22.480137 13868 external_mini_cluster.cc:1428] Setting key 2e6302d70b9085fc5b1bc5b0a6881946
Aug 10 18:36:22 dist-test-slave-5k54 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386982, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:36:22.491137 25910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.474035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:38973 (local address 127.13.139.62:35633)
0810 18:36:22.474524 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.474529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.475241 (+ 712us) server_negotiation.cc:407] Connection header received
0810 18:36:22.477124 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.477130 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.477239 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.477357 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:22.478981 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.479937 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.481546 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.481929 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.482061 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.485628 (+ 3567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:22.485632 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:22.485635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:22.485668 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:22.488206 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:22.489098 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:22.489102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:22.489104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:22.489226 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:22.489620 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:22.489623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:22.489625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:22.489863 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:22.489984 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.490687 (+ 703us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.490847 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":261,"threads_started":1}
I20260810 18:36:22.492184 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.474376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:35633 (local address 127.13.139.3:38973)
0810 18:36:22.475079 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.475123 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.476848 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.477594 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.477602 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.478112 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:36:22.478812 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.478832 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.480100 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.480104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.481370 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.481386 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.482161 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.482170 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.482416 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.483105 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:36:22.483138 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:36:22.485439 (+ 2301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:36:22.488354 (+ 2915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:36:22.488361 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:36:22.488373 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:36:22.488964 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:36:22.489322 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:36:22.489326 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:36:22.489328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:36:22.489524 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:36:22.489972 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:36:22.489977 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:36:22.490294 (+ 317us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.490594 (+ 300us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.491008 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":277,"threads_started":1}
I20260810 18:36:22.493618 25907 heartbeater.cc:347] Connected to a master server at 127.13.139.62:35633
I20260810 18:36:22.493990 25907 heartbeater.cc:464] Registering TS with master...
I20260810 18:36:22.494849 25907 heartbeater.cc:511] Master 127.13.139.62:35633 requested a full tablet report, sending...
I20260810 18:36:22.496378 25399 ts_manager.cc:194] Registered new tserver with Master: 55d186e178b44f94a368da49a4a3dc40 (127.13.139.3:33521)
I20260810 18:36:22.497179 25399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:38973
I20260810 18:36:22.507565 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:36:22.524712 25910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.512654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50456 (local address 127.13.139.62:35633)
0810 18:36:22.512820 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.512825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.513279 (+ 454us) server_negotiation.cc:407] Connection header received
0810 18:36:22.513428 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.513431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.513505 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.513587 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:22.514998 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.515782 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.517021 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.517412 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.517517 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.519896 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:22.519900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:22.519903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:22.519934 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:22.522324 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:22.523046 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:22.523049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:22.523051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:22.523164 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:22.523523 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:22.523526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:22.523528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:22.523816 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:22.524014 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.524309 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.524482 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 18:36:22.528848 25399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:36:22.535873 25399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:36:22.558118 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.547314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:33521 (local address 127.0.0.1:41888)
0810 18:36:22.548266 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.548312 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.549036 (+ 724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.549856 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.549866 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.549926 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:36:22.550438 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.550455 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.553103 (+ 2648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.553110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.555179 (+ 2069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.555190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.557077 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.557085 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.557303 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.557419 (+ 116us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.557543 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.557725 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":498,"threads_started":1}
I20260810 18:36:22.558123 25922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.547745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41888 (local address 127.13.139.3:33521)
0810 18:36:22.548815 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.548825 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.548867 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:36:22.549319 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.549331 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.549596 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.550713 (+ 1117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:36:22.551090 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.552982 (+ 1892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.555335 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.556879 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.557020 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.557254 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.557611 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.557770 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":912,"thread_start_us":765,"threads_started":1}
I20260810 18:36:22.559597 25923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.548245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:39115 (local address 127.0.0.1:47256)
0810 18:36:22.549540 (+ 1295us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.549553 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.549704 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.552339 (+ 2635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.552344 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.552368 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:36:22.552888 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.552903 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.554676 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.554680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.556651 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.556662 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.558787 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.558796 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.558968 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.558991 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.559105 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.559223 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1210,"thread_start_us":1092,"threads_started":1}
I20260810 18:36:22.559648 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.548614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47256 (local address 127.13.139.2:39115)
0810 18:36:22.549219 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.549230 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.549863 (+ 633us) server_negotiation.cc:407] Connection header received
0810 18:36:22.549974 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.549980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.550204 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.551638 (+ 1434us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:36:22.553088 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.554497 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.556820 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.558267 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.558452 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.558639 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.559140 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.559301 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":289,"threads_started":1}
I20260810 18:36:22.561721 25925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.549722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:41451 (local address 127.0.0.1:36316)
0810 18:36:22.552879 (+ 3157us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.552896 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.553024 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.553693 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.553698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.553725 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:36:22.554165 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.554177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.556217 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.556223 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.558610 (+ 2387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.558625 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.560932 (+ 2307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.560938 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.561098 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.561134 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.561234 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.561348 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3013,"thread_start_us":2862,"threads_started":1}
I20260810 18:36:22.562394 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.550086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36316 (local address 127.13.139.1:41451)
0810 18:36:22.552369 (+ 2283us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.552378 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.553012 (+ 634us) server_negotiation.cc:407] Connection header received
0810 18:36:22.553270 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.553280 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.553499 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.553679 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:36:22.554382 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.556073 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.558802 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.560390 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.560533 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.560751 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.561308 (+ 557us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.561517 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2136,"thread_start_us":1979,"threads_started":1}
I20260810 18:36:22.562516 25835 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2822b3c78649fa8203eadb27eebfb3 (DEFAULT_TABLE table=test-table [id=286853f97d094a25b456fc3f36340f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:36:22.562999 25687 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2822b3c78649fa8203eadb27eebfb3 (DEFAULT_TABLE table=test-table [id=286853f97d094a25b456fc3f36340f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:36:22.564193 25835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2822b3c78649fa8203eadb27eebfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:36:22.564474 25687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2822b3c78649fa8203eadb27eebfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:36:22.565930 25536 tablet_service.cc:1467] Processing CreateTablet for tablet 2e2822b3c78649fa8203eadb27eebfb3 (DEFAULT_TABLE table=test-table [id=286853f97d094a25b456fc3f36340f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:36:22.567271 25536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e2822b3c78649fa8203eadb27eebfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:36:22.576174 25927 tablet_bootstrap.cc:492] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Bootstrap starting.
I20260810 18:36:22.578619 25928 tablet_bootstrap.cc:492] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Bootstrap starting.
I20260810 18:36:22.580039 25927 tablet_bootstrap.cc:654] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Neither blocks nor log segments found. Creating new log.
I20260810 18:36:22.581449 25927 log.cc:824] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Log is configured to *not* fsync() on all Append() calls
I20260810 18:36:22.582449 25928 tablet_bootstrap.cc:654] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Neither blocks nor log segments found. Creating new log.
I20260810 18:36:22.582918 25929 tablet_bootstrap.cc:492] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Bootstrap starting.
I20260810 18:36:22.583760 25928 log.cc:824] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Log is configured to *not* fsync() on all Append() calls
I20260810 18:36:22.585001 25927 tablet_bootstrap.cc:492] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: No bootstrap required, opened a new log
I20260810 18:36:22.585325 25927 ts_tablet_manager.cc:1397] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260810 18:36:22.586504 25929 tablet_bootstrap.cc:654] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Neither blocks nor log segments found. Creating new log.
I20260810 18:36:22.586915 25928 tablet_bootstrap.cc:492] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: No bootstrap required, opened a new log
I20260810 18:36:22.587172 25928 ts_tablet_manager.cc:1397] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:36:22.587630 25929 log.cc:824] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Log is configured to *not* fsync() on all Append() calls
I20260810 18:36:22.590500 25929 tablet_bootstrap.cc:492] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: No bootstrap required, opened a new log
I20260810 18:36:22.590776 25929 ts_tablet_manager.cc:1397] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260810 18:36:22.596051 25927 raft_consensus.cc:348] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.596522 25927 raft_consensus.cc:374] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:36:22.596624 25927 raft_consensus.cc:729] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be39436a32e46b4974bb30975e75421, State: Initialized, Role: FOLLOWER
I20260810 18:36:22.597245 25927 consensus_queue.cc:260] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.597901 25929 raft_consensus.cc:348] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.597920 25928 raft_consensus.cc:348] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.598294 25929 raft_consensus.cc:374] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:36:22.598323 25928 raft_consensus.cc:374] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:36:22.598389 25929 raft_consensus.cc:729] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e8e7a07cac544d3a0b7024b0e599b3d, State: Initialized, Role: FOLLOWER
I20260810 18:36:22.598419 25928 raft_consensus.cc:729] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55d186e178b44f94a368da49a4a3dc40, State: Initialized, Role: FOLLOWER
I20260810 18:36:22.598511 25756 heartbeater.cc:503] Master 127.13.139.62:35633 was elected leader, sending a full tablet report...
I20260810 18:36:22.598943 25929 consensus_queue.cc:260] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.599139 25927 ts_tablet_manager.cc:1428] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260810 18:36:22.599098 25928 consensus_queue.cc:260] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.601892 25929 ts_tablet_manager.cc:1428] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260810 18:36:22.603559 25907 heartbeater.cc:503] Master 127.13.139.62:35633 was elected leader, sending a full tablet report...
I20260810 18:36:22.603951 25928 ts_tablet_manager.cc:1428] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Time spent starting tablet: real 0.017s user 0.011s sys 0.008s
W20260810 18:36:22.659471 25609 tablet.cc:2369] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:36:22.694568 25757 tablet.cc:2369] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:36:22.716756 25935 raft_consensus.cc:482] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:36:22.717146 25935 raft_consensus.cc:504] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.718933 25935 leader_election.cc:288] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be39436a32e46b4974bb30975e75421 (127.13.139.2:39115), 6e8e7a07cac544d3a0b7024b0e599b3d (127.13.139.1:41451)
I20260810 18:36:22.722151 25933 raft_consensus.cc:482] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:36:22.722457 25933 raft_consensus.cc:504] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
W20260810 18:36:22.723266 25909 tablet.cc:2369] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:36:22.724514 25933 leader_election.cc:288] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55d186e178b44f94a368da49a4a3dc40 (127.13.139.3:33521), 6e8e7a07cac544d3a0b7024b0e599b3d (127.13.139.1:41451)
I20260810 18:36:22.726572 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.719274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:39115 (local address 127.13.139.3:53983)
0810 18:36:22.719550 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.719574 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.719744 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.720299 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.720304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.720336 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:36:22.720505 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.720513 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.721525 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.721530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.723830 (+ 2300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.723845 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.725800 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.725806 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.726001 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.726036 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.726128 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.726268 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":66}
I20260810 18:36:22.727258 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.719494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:53983 (local address 127.13.139.2:39115)
0810 18:36:22.719720 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.719726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.719747 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:36:22.719902 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.719923 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.720032 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.720143 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:36:22.720649 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.721355 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.724039 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.725415 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.725569 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.725647 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.726846 (+ 1199us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.726992 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:36:22.727906 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.720075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:42745 (local address 127.13.139.1:41451)
0810 18:36:22.720319 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.720327 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.720528 (+ 201us) server_negotiation.cc:407] Connection header received
0810 18:36:22.720725 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.720733 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.720812 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.720911 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:36:22.721418 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.722496 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.725388 (+ 2892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.726709 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.726836 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.726903 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.727494 (+ 591us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.727629 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260810 18:36:22.728861 25936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.719749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:41451 (local address 127.13.139.3:42745)
0810 18:36:22.720425 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.720444 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.720585 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.720925 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.720929 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.720958 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:36:22.721270 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.721278 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.722674 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.722679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.725173 (+ 2494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.725191 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.727087 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.727093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.727264 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.727305 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.728282 (+ 977us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.728455 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":1,"thread_start_us":327,"threads_started":1}
I20260810 18:36:22.729562 25710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2822b3c78649fa8203eadb27eebfb3" candidate_uuid: "55d186e178b44f94a368da49a4a3dc40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be39436a32e46b4974bb30975e75421" is_pre_election: true
I20260810 18:36:22.729875 25559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2822b3c78649fa8203eadb27eebfb3" candidate_uuid: "55d186e178b44f94a368da49a4a3dc40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" is_pre_election: true
I20260810 18:36:22.730165 25710 raft_consensus.cc:2454] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55d186e178b44f94a368da49a4a3dc40 in term 0.
I20260810 18:36:22.730445 25559 raft_consensus.cc:2454] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55d186e178b44f94a368da49a4a3dc40 in term 0.
I20260810 18:36:22.731073 25782 leader_election.cc:302] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55d186e178b44f94a368da49a4a3dc40, 7be39436a32e46b4974bb30975e75421; no voters:
I20260810 18:36:22.731514 25935 raft_consensus.cc:2781] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:36:22.731664 25935 raft_consensus.cc:482] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:36:22.731762 25935 raft_consensus.cc:3037] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:36:22.735071 25935 raft_consensus.cc:504] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.735526 25922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.725265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:35859 (local address 127.13.139.3:33521)
0810 18:36:22.725471 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.725479 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.728886 (+ 3407us) server_negotiation.cc:407] Connection header received
0810 18:36:22.729320 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.729327 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.729416 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.729506 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:36:22.730330 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.731468 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.733598 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.734457 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.734650 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.734727 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.735101 (+ 374us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.735233 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:36:22.735620 25938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.724637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:33521 (local address 127.13.139.2:35859)
0810 18:36:22.728765 (+ 4128us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.728798 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.729163 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.729682 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.729686 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.729713 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:36:22.730174 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.730187 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.731641 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.731646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.733431 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.733447 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.734689 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.734695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.734905 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.734950 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.735050 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.735190 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3983,"mutex_wait_us":23,"thread_start_us":3768,"threads_started":1}
I20260810 18:36:22.736419 25710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2822b3c78649fa8203eadb27eebfb3" candidate_uuid: "55d186e178b44f94a368da49a4a3dc40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be39436a32e46b4974bb30975e75421"
I20260810 18:36:22.736668 25710 raft_consensus.cc:3037] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:36:22.736730 25859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2822b3c78649fa8203eadb27eebfb3" candidate_uuid: "7be39436a32e46b4974bb30975e75421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55d186e178b44f94a368da49a4a3dc40" is_pre_election: true
I20260810 18:36:22.736961 25935 leader_election.cc:288] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [CANDIDATE]: Term 1 election: Requested vote from peers 7be39436a32e46b4974bb30975e75421 (127.13.139.2:39115), 6e8e7a07cac544d3a0b7024b0e599b3d (127.13.139.1:41451)
I20260810 18:36:22.737277 25859 raft_consensus.cc:2379] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7be39436a32e46b4974bb30975e75421 in current term 1: Already voted for candidate 55d186e178b44f94a368da49a4a3dc40 in this term.
I20260810 18:36:22.737427 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.725595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:36695 (local address 127.13.139.1:41451)
0810 18:36:22.728162 (+ 2567us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.728173 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.729909 (+ 1736us) server_negotiation.cc:407] Connection header received
0810 18:36:22.730343 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.730348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.730430 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.730504 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:36:22.731306 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.732454 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.734928 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.736335 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.736519 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.736589 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.736929 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.737085 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2459,"thread_start_us":2279,"threads_started":1}
I20260810 18:36:22.738058 25939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.725046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:41451 (local address 127.13.139.2:36695)
0810 18:36:22.729797 (+ 4751us) negotiation.cc:107] Waiting for socket to connect
0810 18:36:22.729815 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:36:22.730082 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:36:22.730763 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:36:22.730768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:36:22.730792 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:36:22.731146 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.731160 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.732602 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.732610 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.734755 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:36:22.734777 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.736538 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.736545 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:36:22.736735 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.736773 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 18:36:22.737629 (+ 856us) client_negotiation.cc:240] Negotiation successful
0810 18:36:22.737765 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4600,"mutex_wait_us":1,"thread_start_us":5478,"threads_started":1}
I20260810 18:36:22.738420 25559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2822b3c78649fa8203eadb27eebfb3" candidate_uuid: "55d186e178b44f94a368da49a4a3dc40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d"
I20260810 18:36:22.738637 25559 raft_consensus.cc:3037] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:36:22.740116 25710 raft_consensus.cc:2454] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55d186e178b44f94a368da49a4a3dc40 in term 1.
I20260810 18:36:22.741089 25557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e2822b3c78649fa8203eadb27eebfb3" candidate_uuid: "7be39436a32e46b4974bb30975e75421" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" is_pre_election: true
I20260810 18:36:22.741914 25559 raft_consensus.cc:2454] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55d186e178b44f94a368da49a4a3dc40 in term 1.
I20260810 18:36:22.742364 25782 leader_election.cc:302] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55d186e178b44f94a368da49a4a3dc40, 6e8e7a07cac544d3a0b7024b0e599b3d; no voters:
I20260810 18:36:22.742681 25935 raft_consensus.cc:2781] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:36:22.742947 25636 leader_election.cc:302] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7be39436a32e46b4974bb30975e75421; no voters: 55d186e178b44f94a368da49a4a3dc40, 6e8e7a07cac544d3a0b7024b0e599b3d
I20260810 18:36:22.743258 25935 raft_consensus.cc:686] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 1 LEADER]: Becoming Leader. State: Replica: 55d186e178b44f94a368da49a4a3dc40, State: Running, Role: LEADER
I20260810 18:36:22.743686 25933 raft_consensus.cc:2726] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 18:36:22.743928 25935 consensus_queue.cc:237] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } }
I20260810 18:36:22.748358 25396 catalog_manager.cc:5495] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 55d186e178b44f94a368da49a4a3dc40 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "55d186e178b44f94a368da49a4a3dc40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55d186e178b44f94a368da49a4a3dc40" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 } health_report { overall_health: UNKNOWN } } }
I20260810 18:36:22.801795 25922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.796196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41892 (local address 127.13.139.3:33521)
0810 18:36:22.796401 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.796407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.796547 (+ 140us) server_negotiation.cc:407] Connection header received
0810 18:36:22.796804 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.796808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.796901 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.797081 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:36:22.797496 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.798254 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.799643 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.800048 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.800183 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.800687 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:36:22.801188 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:36:22.801363 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.801416 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.801499 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:36:22.810288 25559 raft_consensus.cc:1261] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 1 FOLLOWER]: Refusing update from remote peer 55d186e178b44f94a368da49a4a3dc40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:36:22.810286 25710 raft_consensus.cc:1261] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 1 FOLLOWER]: Refusing update from remote peer 55d186e178b44f94a368da49a4a3dc40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:36:22.811211 25941 consensus_queue.cc:1035] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e8e7a07cac544d3a0b7024b0e599b3d" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 41451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:36:22.811647 25935 consensus_queue.cc:1035] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be39436a32e46b4974bb30975e75421" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:36:22.838755 25399 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:36:22.839100 25399 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:36:22.842897 25399 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6e2b1467116147b48403d37766d86993: Sending DeleteTablet for 3 replicas of tablet 2e2822b3c78649fa8203eadb27eebfb3
I20260810 18:36:22.844027 25835 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2822b3c78649fa8203eadb27eebfb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:36:22 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:41888
I20260810 18:36:22.844584 25687 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2822b3c78649fa8203eadb27eebfb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:36:22 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:47256
I20260810 18:36:22.845280 25536 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e2822b3c78649fa8203eadb27eebfb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:36:22 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:36316
I20260810 18:36:22.845713 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 25465
I20260810 18:36:22.849699 25958 tablet_replica.cc:330] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: stopping tablet replica
I20260810 18:36:22.850232 25958 raft_consensus.cc:2229] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:36:22.850816 25958 raft_consensus.cc:2258] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:36:22.852589 25958 ts_tablet_manager.cc:1905] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:36:22.859843 25956 tablet_replica.cc:330] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: stopping tablet replica
I20260810 18:36:22.860311 25956 raft_consensus.cc:2229] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:36:22.860633 25957 tablet_replica.cc:330] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: stopping tablet replica
I20260810 18:36:22.861142 25956 raft_consensus.cc:2258] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:36:22.859381 25958 ts_tablet_manager.cc:1918] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:36:22.861629 25958 log.cc:1196] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/2e2822b3c78649fa8203eadb27eebfb3
I20260810 18:36:22.861850 25957 raft_consensus.cc:2229] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:36:22.862216 25958 ts_tablet_manager.cc:1939] T 2e2822b3c78649fa8203eadb27eebfb3 P 6e8e7a07cac544d3a0b7024b0e599b3d: Deleting consensus metadata
I20260810 18:36:22.862511 25957 raft_consensus.cc:2258] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:36:22.864641 25957 ts_tablet_manager.cc:1905] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 18:36:22 dist-test-slave-5k54 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:36:22.865176 25382 catalog_manager.cc:4841] TS 6e8e7a07cac544d3a0b7024b0e599b3d (127.13.139.1:41451): tablet 2e2822b3c78649fa8203eadb27eebfb3 (table test-table [id=286853f97d094a25b456fc3f36340f40]) successfully deleted
I20260810 18:36:22.865885 25956 ts_tablet_manager.cc:1905] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:36:22.872812 25957 ts_tablet_manager.cc:1918] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:36:22.873054 25957 log.cc:1196] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/2e2822b3c78649fa8203eadb27eebfb3
I20260810 18:36:22.873255 25956 ts_tablet_manager.cc:1918] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:36:22.873431 25956 log.cc:1196] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/2e2822b3c78649fa8203eadb27eebfb3
I20260810 18:36:22.873834 25957 ts_tablet_manager.cc:1939] T 2e2822b3c78649fa8203eadb27eebfb3 P 7be39436a32e46b4974bb30975e75421: Deleting consensus metadata
I20260810 18:36:22.874019 25956 ts_tablet_manager.cc:1939] T 2e2822b3c78649fa8203eadb27eebfb3 P 55d186e178b44f94a368da49a4a3dc40: Deleting consensus metadata
I20260810 18:36:22.875739 25384 catalog_manager.cc:4841] TS 55d186e178b44f94a368da49a4a3dc40 (127.13.139.3:33521): tablet 2e2822b3c78649fa8203eadb27eebfb3 (table test-table [id=286853f97d094a25b456fc3f36340f40]) successfully deleted
I20260810 18:36:22.882689 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:22.846963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36318 (local address 127.13.139.1:41451)
0810 18:36:22.847136 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:22.847142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:22.848900 (+ 1758us) server_negotiation.cc:407] Connection header received
0810 18:36:22.849127 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:22.849134 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:22.849246 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:22.849354 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:22.856166 (+ 6812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.857394 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.859369 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:22.860059 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:22.860160 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:22.866675 (+ 6515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:22.866689 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:22.866705 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:22.866754 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:22.878609 (+ 11855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:22.880043 (+ 1434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:22.880053 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:22.880056 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:22.880258 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:22.880742 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:22.880748 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:22.880751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:22.881223 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:22.881500 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:22.882125 (+ 625us) server_negotiation.cc:299] Negotiation successful
0810 18:36:22.882359 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 18:36:22.883847 25382 catalog_manager.cc:4841] TS 7be39436a32e46b4974bb30975e75421 (127.13.139.2:39115): tablet 2e2822b3c78649fa8203eadb27eebfb3 (table test-table [id=286853f97d094a25b456fc3f36340f40]) successfully deleted
I20260810 18:36:22.884142 25602 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:22.993287 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 25465
I20260810 18:36:23.014597 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 25614
Aug 10 18:36:23 dist-test-slave-5k54 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:36:23.031061 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:23.015503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47266 (local address 127.13.139.2:39115)
0810 18:36:23.015724 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:23.015731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:23.015753 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:36:23.015827 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:23.015833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:23.015928 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:23.016033 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:23.017264 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:23.018465 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:23.019932 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:23.020592 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:23.020731 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:23.025158 (+ 4427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:23.025171 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:23.025186 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:23.025219 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:23.028302 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:23.028997 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:23.029005 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:23.029007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:23.029133 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:23.029516 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:23.029525 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:23.029527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:23.029906 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:23.030225 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:23.030501 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 18:36:23.030732 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 18:36:23.031703 25750 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:23.124665 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 25614
I20260810 18:36:23.146041 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 25762
Aug 10 18:36:23 dist-test-slave-5k54 krb5kdc[25350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:36:23.162554 25922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:36:23.147258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41906 (local address 127.13.139.3:33521)
0810 18:36:23.147413 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 18:36:23.147418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:36:23.147486 (+ 68us) server_negotiation.cc:407] Connection header received
0810 18:36:23.147564 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:36:23.147568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:36:23.147645 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:36:23.147762 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:36:23.149057 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:23.149788 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:23.151006 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:36:23.151744 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:36:23.151890 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:36:23.156427 (+ 4537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:36:23.156440 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:36:23.156454 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:36:23.156504 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:36:23.159723 (+ 3219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:23.160374 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:23.160389 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:23.160391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:23.160538 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:36:23.160928 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:36:23.160935 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:36:23.160940 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:36:23.161353 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:36:23.161662 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0810 18:36:23.161991 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 18:36:23.162231 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 18:36:23.163362 25901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:23.293041 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 25762
I20260810 18:36:23.324913 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 25364
I20260810 18:36:23.326340 25433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:36:23.440157 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 25364
2026-08-10T18:36:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4619 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:36:23 dist-test-slave-5k54 krb5kdc[25968](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:36:23 dist-test-slave-5k54 krb5kdc[25968](info): set up 2 sockets
Aug 10 18:36:23 dist-test-slave-5k54 krb5kdc[25968](info): commencing operation
krb5kdc: starting...
W20260810 18:36:24.619607 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:36:24 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786386984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:36:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:36:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/rangeradmin_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/rangeradmin_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/rangerlookup_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/rangerlookup_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
I20260810 18:36:25.027354 13868 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task4ILylI/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/postgres -l logfile start
2026-08-10 18:36:27.495 UTC [26002] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 18:36:27.496 UTC [26002] LOG: listening on IPv4 address "127.13.139.20", port 43445
2026-08-10 18:36:27.499 UTC [26002] LOG: listening on Unix socket "/tmp/.s.PGSQL.43445"
2026-08-10 18:36:27.522 UTC [26005] LOG: database system was shut down at 2026-08-10 18:36:26 UTC
2026-08-10 18:36:27.526 UTC [26002] LOG: database system is ready to accept connections
I20260810 18:36:28.572647 13868 mini_postgres.cc:96] Postgres bound to 43445
2026-08-10 18:36:28.597 UTC [26014] FATAL: database "slave" does not exist
127.13.139.20:43445 - accepting connections
I20260810 18:36:28.598780 13868 mini_ranger.cc:161] Starting Ranger...
I20260810 18:36:28.629092 13868 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 18:36:29.104527 13868 mini_ranger.cc:87] Created ranger Postgres database
I20260810 18:36:29.104676 13868 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-admin
2026-08-10 18:36:29,498 [I] DB FLAVOR :POSTGRES
2026-08-10 18:36:29,498 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 18:36:29,499 [I] Checking connection..
2026-08-10 18:36:29,499 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 18:36:29,768 [I] Checking connection passed.
2026-08-10 18:36:29,769 [I] --------- Verifying version history table ---------
2026-08-10 18:36:29,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 18:36:30,033 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 18:36:30,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 18:36:30,273 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 18:36:30,273 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 18:36:30,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 18:36:30.526 UTC [26082] WARNING: there is no transaction in progress
2026-08-10 18:36:30,533 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 18:36:30,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 18:36:30,773 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 18:36:30,773 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 18:36:30,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 18:36:31,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 18:36:31,278 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-5k54.c.gcp-upstream.internal','N') ;"
2026-08-10 18:36:31,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 18:36:31,771 [I] Table x_portal_user does not exist in database ranger
2026-08-10 18:36:31,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 18:36:32,024 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 18:36:32,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 18:36:32,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 18:36:32,531 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 18:36:32,531 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 18:36:33.509 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.526 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.543 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.559 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.576 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.594 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.657 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.664 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.678 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.688 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.699 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.712 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.721 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.728 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.734 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:33.741 UTC [26203] WARNING: there is no transaction in progress
2026-08-10 18:36:34,385 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 18:36:34,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 18:36:34,646 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 18:36:34,646 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 18:36:34,890 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 18:36:34,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 18:36:35,156 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 18:36:35,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 18:36:35,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 18:36:35,640 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-5k54.c.gcp-upstream.internal';"
2026-08-10 18:36:35,910 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 18:36:35,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 18:36:36,144 [I] DB_PATCHES have already been applied
I20260810 18:36:36.150885 13868 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-admin:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task4ILylI/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 18:36:36.150974 13868 mini_ranger.cc:193] Using host: 127.13.139.20
I20260810 18:36:36.171612 13868 mini_ranger.cc:227] Ranger admin URL: http://127.13.139.20:56945
Aug 10, 2026 6:36:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:36:36 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:36:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 6:36:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 6:36:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 6:36:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 6:36:37 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 18:36:37.413501 13868 mini_ranger.cc:160] Time spent starting Ranger: real 8.815s user 0.005s sys 0.054s
Aug 10, 2026 6:36:57 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 6:36:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 10, 2026 6:36:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 6:36:57 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 6:36:58 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 18:36:59.532977 13868 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/rangerkms_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/rangerkms_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.139.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.139.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 18:36:59 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387019, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 18:36:59.755662 13868 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 18:36:59.782853 13868 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 18:37:00.643208 13868 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 18:37:00.643400 13868 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms
I20260810 18:37:00.643576 13868 mini_ranger_kms.cc:227] Using postgres at 127.13.139.20:43445
2026-08-10 18:37:01,470 [I] DB FLAVOR :POSTGRES
2026-08-10 18:37:01,471 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 18:37:01,471 [I] Checking connection
2026-08-10 18:37:01,471 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 18:37:01,717 [I] connection success
2026-08-10 18:37:01,717 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 18:37:01,717 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 18:37:01,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 18:37:01,950 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 18:37:01,950 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 18:37:01,951 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 18:37:01,951 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:43445/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 18:37:02,221 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 18:37:02.728561 13868 mini_ranger_kms.cc:310] Created kms service
I20260810 18:37:02.913322 13868 mini_ranger_kms.cc:326] Created kudu user
I20260810 18:37:02.958513 13868 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 18:37:02 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387019, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:37:03.402699 13868 mini_ranger_kms.cc:384] Added ranger policy
I20260810 18:37:03.403200 13868 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms:/tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 18:37:03.403250 13868 mini_ranger_kms.cc:240] Using host: 127.13.139.20
I20260810 18:37:03.428716 13868 mini_ranger_kms.cc:276] Ranger KMS PID: 26410
I20260810 18:37:03.428927 13868 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.139.20:58213
Aug 10, 2026 6:37:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:37:04 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:37:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 6:37:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 6:37:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 6:37:04 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 18:37:05 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786387025, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.139.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:37:05.927145 13868 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.172s user 0.133s sys 0.417s
I20260810 18:37:05.927899 13868 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 18:37:05.928145 13868 mini_ranger_kms.cc:401] 127.13.139.20:58213/kms/v1/keys
Aug 10 18:37:06 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387025, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.139.20@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
Aug 10 18:37:06 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387025, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.139.20@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
Aug 10 18:37:08 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:37:08.743366 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46747
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:46747
--ranger_config_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:58213/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:37:09.099413 26464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:37:09.099786 26464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:37:09.099879 26464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:37:09.107744 26464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:37:09.107863 26464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:37:09.107916 26464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:37:09.108021 26464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:37:09.108078 26464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:37:09.119076 26464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.139.20:58213/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:46747
--ranger_config_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:37:09.120574 26464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:37:09.121905 26464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:37:09.134684 26474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:37:09.134645 26472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:37:09.134732 26471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:37:09.136765 26464 server_base.cc:1034] running on GCE node
I20260810 18:37:09.137601 26464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:37:09.138945 26464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:37:09.140137 26464 hybrid_clock.cc:648] HybridClock initialized: now 1786387029140101 us; error 30 us; skew 500 ppm
I20260810 18:37:09.140465 26464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:37:09 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387029, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:37:09.148938 26464 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:37:09.150409 26464 webserver.cc:460] Webserver started at http://127.13.139.62:41387/ using document root <none> and password file <none>
I20260810 18:37:09.151100 26464 fs_manager.cc:359] Metadata directory not provided
I20260810 18:37:09.151224 26464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:37:09.151585 26464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:37:09 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387029, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:37:09.202602 26464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "37a407695e974dee8d7abc6391d60ae8"
format_stamp: "Formatted at 2026-08-10 18:37:09 on dist-test-slave-5k54"
server_key: "23a5298b26e0dc6fca7cca468c51a0fb"
server_key_iv: "5dc6e5574da0333ee6191371a61be203"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:09.203642 26464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "37a407695e974dee8d7abc6391d60ae8"
format_stamp: "Formatted at 2026-08-10 18:37:09 on dist-test-slave-5k54"
server_key: "23a5298b26e0dc6fca7cca468c51a0fb"
server_key_iv: "5dc6e5574da0333ee6191371a61be203"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:09.210233 26464 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260810 18:37:09.230959 26481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:09.232568 26464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:37:09.232758 26464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "37a407695e974dee8d7abc6391d60ae8"
format_stamp: "Formatted at 2026-08-10 18:37:09 on dist-test-slave-5k54"
server_key: "23a5298b26e0dc6fca7cca468c51a0fb"
server_key_iv: "5dc6e5574da0333ee6191371a61be203"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:09.233019 26464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:37:09.249887 26464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:37:09.254488 26464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:37:09.254810 26464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:37:09.273720 26464 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:46747
I20260810 18:37:09.273746 26538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:46747 every 8 connection(s)
I20260810 18:37:09.275138 26464 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:37:09.277773 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 26464
I20260810 18:37:09.277995 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:37:09.278669 13868 external_mini_cluster.cc:1428] Setting key 098f03a10ccaf645e056e06ca67b8ad1
I20260810 18:37:09.279177 26539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:37:09.293622 26539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8: Bootstrap starting.
Aug 10 18:37:09 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:37:09.297331 26539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8: Neither blocks nor log segments found. Creating new log.
I20260810 18:37:09.298484 26539 log.cc:824] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:37:09.301381 26539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8: No bootstrap required, opened a new log
I20260810 18:37:09.302196 26542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:09.280645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52822 (local address 127.13.139.62:46747)
0810 18:37:09.281411 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:09.281423 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:09.281469 (+ 46us) server_negotiation.cc:407] Connection header received
0810 18:37:09.283891 (+ 2422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:09.283911 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:09.284272 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:09.284591 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:09.286249 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:09.287628 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:09.289429 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:09.290104 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:09.290237 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:09.294937 (+ 4700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:09.294947 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:09.294959 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:09.294993 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:09.298060 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:09.298827 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:09.298832 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:09.298838 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:09.298995 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:09.299399 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:09.299409 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:09.299412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:09.300005 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:09.300309 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:09.300760 (+ 451us) server_negotiation.cc:299] Negotiation successful
0810 18:37:09.301155 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":386,"threads_started":1}
I20260810 18:37:09.309463 26539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a407695e974dee8d7abc6391d60ae8" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46747 } }
I20260810 18:37:09.309829 26539 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:37:09.309945 26539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37a407695e974dee8d7abc6391d60ae8, State: Initialized, Role: FOLLOWER
I20260810 18:37:09.310465 26539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a407695e974dee8d7abc6391d60ae8" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46747 } }
I20260810 18:37:09.310737 26539 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:37:09.310951 26539 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:37:09.311182 26539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:37:09.313490 26539 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a407695e974dee8d7abc6391d60ae8" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46747 } }
I20260810 18:37:09.313915 26539 leader_election.cc:302] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37a407695e974dee8d7abc6391d60ae8; no voters:
I20260810 18:37:09.314426 26539 leader_election.cc:288] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:37:09.314587 26545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:37:09.315322 26545 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [term 1 LEADER]: Becoming Leader. State: Replica: 37a407695e974dee8d7abc6391d60ae8, State: Running, Role: LEADER
I20260810 18:37:09.315886 26545 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a407695e974dee8d7abc6391d60ae8" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46747 } }
I20260810 18:37:09.316488 26539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:37:09.318760 26547 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37a407695e974dee8d7abc6391d60ae8. Latest consensus state: current_term: 1 leader_uuid: "37a407695e974dee8d7abc6391d60ae8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a407695e974dee8d7abc6391d60ae8" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46747 } } }
I20260810 18:37:09.319123 26547 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [sys.catalog]: This master's current role is: LEADER
I20260810 18:37:09.319504 26546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37a407695e974dee8d7abc6391d60ae8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a407695e974dee8d7abc6391d60ae8" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46747 } } }
I20260810 18:37:09.319978 26546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8 [sys.catalog]: This master's current role is: LEADER
I20260810 18:37:09.324491 26539 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 18:37:09.336051 26551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:37:09.342612 26551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:37:09.352802 26551 catalog_manager.cc:1347] Generated new cluster ID: b308639dc447482db488994678383727
I20260810 18:37:09.352921 26551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:37:09.366171 26551 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:37:09.368310 26551 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:37:09.383634 26551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8: Generated new TSK 0
I20260810 18:37:09.384760 26551 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:37:10.144055 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:58213/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46747
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:37:10 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786387030, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 18:37:10.619524 26589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:37:10.619859 26589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:37:10.620088 26589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:37:10.628050 26589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:37:10.628213 26589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:37:10.628417 26589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:37:10.640025 26589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.139.20:58213/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:37:10.641499 26589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:37:10.642907 26589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:37:10.667598 26600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:37:10.667989 26599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:37:10.674212 26589 server_base.cc:1034] running on GCE node
W20260810 18:37:10.674926 26602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:37:10.675979 26589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:37:10.679080 26589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:37:10.680368 26589 hybrid_clock.cc:648] HybridClock initialized: now 1786387030680241 us; error 116 us; skew 500 ppm
I20260810 18:37:10.680734 26589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:37:10 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387030, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:37:10.685405 26589 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:37:10.687994 26589 webserver.cc:460] Webserver started at http://127.13.139.1:45551/ using document root <none> and password file <none>
I20260810 18:37:10.688952 26589 fs_manager.cc:359] Metadata directory not provided
I20260810 18:37:10.689134 26589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:37:10.689563 26589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:37:10 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387030, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:37:10.708294 26589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "e560ae476240485fa0bbc698a60822d2"
format_stamp: "Formatted at 2026-08-10 18:37:10 on dist-test-slave-5k54"
server_key: "e4ba148da945fd7cbd16dd98fc13f5d2"
server_key_iv: "0dced07eb60ba15320ab12f8395e8540"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:10.710947 26589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "e560ae476240485fa0bbc698a60822d2"
format_stamp: "Formatted at 2026-08-10 18:37:10 on dist-test-slave-5k54"
server_key: "e4ba148da945fd7cbd16dd98fc13f5d2"
server_key_iv: "0dced07eb60ba15320ab12f8395e8540"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:10.719238 26589 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.002s
I20260810 18:37:10.760196 26609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:10.762388 26589 fs_manager.cc:725] Time spent opening block manager: real 0.025s user 0.002s sys 0.003s
I20260810 18:37:10.762713 26589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "e560ae476240485fa0bbc698a60822d2"
format_stamp: "Formatted at 2026-08-10 18:37:10 on dist-test-slave-5k54"
server_key: "e4ba148da945fd7cbd16dd98fc13f5d2"
server_key_iv: "0dced07eb60ba15320ab12f8395e8540"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:10.763118 26589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:37:10.795370 26589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:37:10.801146 26589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:37:10.801594 26589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:37:10.803942 26589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:37:10.808300 26589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:37:10.808454 26589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 18:37:10.808612 26589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:37:10.808704 26589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:10.902729 26589 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:43901
I20260810 18:37:10.902824 26730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:43901 every 8 connection(s)
I20260810 18:37:10.904763 26589 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:37:10.907601 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 26589
I20260810 18:37:10.907815 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:37:10.908670 13868 external_mini_cluster.cc:1428] Setting key ce903ea7836fd756973cf7b2d639dff8
Aug 10 18:37:10 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387030, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
Aug 10 18:37:10 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387030, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:37:10.998324 26734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:10.922535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:49769 (local address 127.13.139.62:46747)
0810 18:37:10.950830 (+ 28295us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:10.950840 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:10.950874 (+ 34us) server_negotiation.cc:407] Connection header received
0810 18:37:10.959614 (+ 8740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:10.959621 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:10.959740 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:10.959832 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:10.962323 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:10.963560 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:10.979505 (+ 15945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:10.980330 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:10.980461 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:10.986978 (+ 6517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:10.986986 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:10.986991 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:10.987036 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:10.992208 (+ 5172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:10.993509 (+ 1301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:10.993515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:10.993519 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:10.993768 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:10.994924 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:10.994929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:10.994932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:10.995645 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:10.995829 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:10.997428 (+ 1599us) server_negotiation.cc:299] Negotiation successful
0810 18:37:10.997741 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28107,"thread_start_us":28339,"threads_started":1}
I20260810 18:37:11.001423 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:10.923391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46747 (local address 127.13.139.1:49769)
0810 18:37:10.941988 (+ 18597us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:10.942075 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:10.954859 (+ 12784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:10.960467 (+ 5608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:10.960479 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:10.961184 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:37:10.962100 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:10.962129 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:10.963766 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:10.963771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:10.967027 (+ 3256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:10.967043 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:10.980924 (+ 13881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:10.980935 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:10.981446 (+ 511us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:10.982568 (+ 1122us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:37:10.982621 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:37:10.986584 (+ 3963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:37:10.992435 (+ 5851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:37:10.992445 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:37:10.992464 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:37:10.993320 (+ 856us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:37:10.993991 (+ 671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:37:10.993997 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:37:10.994001 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:37:10.994637 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:37:10.995992 (+ 1355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:37:10.996009 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:37:10.996728 (+ 719us) client_negotiation.cc:769] Sending connection context
0810 18:37:10.998881 (+ 2153us) client_negotiation.cc:240] Negotiation successful
0810 18:37:10.999609 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18096,"thread_start_us":23015,"threads_started":1}
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:37:11.004071 26731 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46747
I20260810 18:37:11.004413 26731 heartbeater.cc:464] Registering TS with master...
I20260810 18:37:11.005378 26731 heartbeater.cc:511] Master 127.13.139.62:46747 requested a full tablet report, sending...
I20260810 18:37:11.008239 26501 ts_manager.cc:194] Registered new tserver with Master: e560ae476240485fa0bbc698a60822d2 (127.13.139.1:43901)
I20260810 18:37:11.010641 26501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:49769
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
W20260810 18:37:11.059196 13868 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.13.139.2: real 0.147s user 0.000s sys 0.024s
I20260810 18:37:11.060273 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:58213/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46747
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:37:11 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387030, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
W20260810 18:37:11.598731 26738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:37:11.599267 26738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:37:11.599535 26738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:37:11.611402 26738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:37:11.611677 26738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:37:11.611924 26738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:37:11.627924 26738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.139.20:58213/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:37:11.629757 26738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:37:11.631589 26738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:37:11.650171 26754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:37:11.651095 26753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:37:11.651208 26756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:37:11.653110 26738 server_base.cc:1034] running on GCE node
I20260810 18:37:11.653841 26738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:37:11.655105 26738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:37:11.656359 26738 hybrid_clock.cc:648] HybridClock initialized: now 1786387031656285 us; error 69 us; skew 500 ppm
I20260810 18:37:11.656744 26738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:37:11 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387031, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:37:11.660817 26738 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:37:11.662535 26738 webserver.cc:460] Webserver started at http://127.13.139.2:33155/ using document root <none> and password file <none>
I20260810 18:37:11.663277 26738 fs_manager.cc:359] Metadata directory not provided
I20260810 18:37:11.663475 26738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:37:11.663807 26738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:37:11 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387031, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:37:11.681783 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "40bdc3fefb854021bf3073774ed1a8bc"
format_stamp: "Formatted at 2026-08-10 18:37:11 on dist-test-slave-5k54"
server_key: "bac46419c91df144f1d0d3f6adc745e7"
server_key_iv: "ea8853d21c7e923fed77b2493d630737"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:11.682951 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "40bdc3fefb854021bf3073774ed1a8bc"
format_stamp: "Formatted at 2026-08-10 18:37:11 on dist-test-slave-5k54"
server_key: "bac46419c91df144f1d0d3f6adc745e7"
server_key_iv: "ea8853d21c7e923fed77b2493d630737"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:11.690156 26738 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260810 18:37:11.716171 26763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:11.718371 26738 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.007s
I20260810 18:37:11.718585 26738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "40bdc3fefb854021bf3073774ed1a8bc"
format_stamp: "Formatted at 2026-08-10 18:37:11 on dist-test-slave-5k54"
server_key: "bac46419c91df144f1d0d3f6adc745e7"
server_key_iv: "ea8853d21c7e923fed77b2493d630737"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:11.718858 26738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:37:11.749002 26738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:37:11.753890 26738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:37:11.754256 26738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:37:11.755395 26738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:37:11.756907 26738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:37:11.756983 26738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:11.757123 26738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:37:11.757177 26738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:11.802395 26738 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:41729
I20260810 18:37:11.802511 26891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:41729 every 8 connection(s)
I20260810 18:37:11.804029 26738 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:37:11.813019 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 26738
I20260810 18:37:11.813234 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:37:11.813875 13868 external_mini_cluster.cc:1428] Setting key 90ee4e33e337db6edbfaf9dc87ed6fcd
Aug 10 18:37:11 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387031, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:37:11.834756 26897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:11.808718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46747 (local address 127.13.139.2:42829)
0810 18:37:11.810565 (+ 1847us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:11.810610 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:11.812490 (+ 1880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:11.813370 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:11.813383 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:11.814150 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:37:11.815084 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:11.815110 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:11.816965 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:11.816970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:11.819348 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:11.819367 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:11.820725 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:11.820735 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:11.821106 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:11.822016 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:37:11.822052 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:37:11.825365 (+ 3313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:37:11.829454 (+ 4089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:37:11.829464 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:37:11.829482 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:37:11.829975 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:37:11.830519 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:37:11.830527 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:37:11.830533 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:37:11.830796 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:37:11.831671 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:37:11.831683 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:37:11.832162 (+ 479us) client_negotiation.cc:769] Sending connection context
0810 18:37:11.832487 (+ 325us) client_negotiation.cc:240] Negotiation successful
0810 18:37:11.833122 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1548,"thread_start_us":417,"threads_started":1}
I20260810 18:37:11.836551 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:11.808065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:42829 (local address 127.13.139.62:46747)
0810 18:37:11.808595 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:11.808601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:11.810744 (+ 2143us) server_negotiation.cc:407] Connection header received
0810 18:37:11.812828 (+ 2084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:11.812835 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:11.812948 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:11.813085 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:11.815301 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:11.816731 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:11.819556 (+ 2825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:11.820433 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:11.820653 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:11.825684 (+ 5031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:11.825693 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:11.825700 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:11.825751 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:11.829286 (+ 3535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:11.830119 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:11.830128 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:11.830134 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:11.830371 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:11.830937 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:11.830945 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:11.830951 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:11.831408 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:11.831592 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:11.835305 (+ 3713us) server_negotiation.cc:299] Negotiation successful
0810 18:37:11.835619 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":264,"threads_started":1}
I20260810 18:37:11.838228 26892 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46747
I20260810 18:37:11.838587 26892 heartbeater.cc:464] Registering TS with master...
I20260810 18:37:11.839500 26892 heartbeater.cc:511] Master 127.13.139.62:46747 requested a full tablet report, sending...
I20260810 18:37:11.841284 26501 ts_manager.cc:194] Registered new tserver with Master: 40bdc3fefb854021bf3073774ed1a8bc (127.13.139.2:41729)
I20260810 18:37:11.842633 26501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:42829
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:37:11.885160 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:58213/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46747
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:37:12.014757 26731 heartbeater.cc:503] Master 127.13.139.62:46747 was elected leader, sending a full tablet report...
W20260810 18:37:12.261956 26900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:37:12.262274 26900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:37:12.262440 26900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:37:12.270401 26900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:37:12.270548 26900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:37:12.270710 26900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:37:12.280735 26900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.139.20:58213/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:37:12.282179 26900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:37:12.283589 26900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:37:12.298067 26907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:37:12.298112 26909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:37:12.298067 26906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:37:12.300855 26900 server_base.cc:1034] running on GCE node
I20260810 18:37:12.301470 26900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:37:12.302439 26900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:37:12.303663 26900 hybrid_clock.cc:648] HybridClock initialized: now 1786387032303604 us; error 45 us; skew 500 ppm
I20260810 18:37:12.303987 26900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:37:12 dist-test-slave-5k54 krb5kdc[25968](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:37:12.307241 26900 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:37:12.308858 26900 webserver.cc:460] Webserver started at http://127.13.139.3:34991/ using document root <none> and password file <none>
I20260810 18:37:12.309574 26900 fs_manager.cc:359] Metadata directory not provided
I20260810 18:37:12.309718 26900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:37:12.310108 26900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:37:12 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:37:12.327605 26900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "b54ada8ce4664a53bfcc8a60909987c4"
format_stamp: "Formatted at 2026-08-10 18:37:12 on dist-test-slave-5k54"
server_key: "0fc71a19c5f80d7758e2c83998f5eb38"
server_key_iv: "84b0b2893d1d0f2a9d8a52b10eecb607"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:12.328835 26900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "b54ada8ce4664a53bfcc8a60909987c4"
format_stamp: "Formatted at 2026-08-10 18:37:12 on dist-test-slave-5k54"
server_key: "0fc71a19c5f80d7758e2c83998f5eb38"
server_key_iv: "84b0b2893d1d0f2a9d8a52b10eecb607"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:12.336126 26900 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260810 18:37:12.351859 26916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:12.353453 26900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:37:12.353641 26900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "b54ada8ce4664a53bfcc8a60909987c4"
format_stamp: "Formatted at 2026-08-10 18:37:12 on dist-test-slave-5k54"
server_key: "0fc71a19c5f80d7758e2c83998f5eb38"
server_key_iv: "84b0b2893d1d0f2a9d8a52b10eecb607"
server_key_version: "kuduclusterkey@0"
I20260810 18:37:12.353875 26900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:37:12.372071 26900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:37:12.375731 26900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:37:12.376039 26900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:37:12.376986 26900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:37:12.378405 26900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:37:12.378512 26900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:12.378662 26900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:37:12.378736 26900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:37:12.418510 26900 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:33927
I20260810 18:37:12.418569 27043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:33927 every 8 connection(s)
I20260810 18:37:12.419932 26900 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:37:12.427109 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 26900
I20260810 18:37:12.427294 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:37:12.427747 13868 external_mini_cluster.cc:1428] Setting key 25ed3033efd2275d72c8e213b2dfc112
Aug 10 18:37:12 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387032, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:37:12.441011 27047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.422553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:50703 (local address 127.13.139.62:46747)
0810 18:37:12.423088 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.423093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.423896 (+ 803us) server_negotiation.cc:407] Connection header received
0810 18:37:12.426041 (+ 2145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.426046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.426156 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.426285 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:12.427863 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.428766 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.430533 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.430971 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.431102 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.434512 (+ 3410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:12.434516 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:12.434519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:12.434551 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:12.437450 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.438307 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.438312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.438322 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.438455 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.438919 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.438930 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.438934 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.439199 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:12.439355 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.440370 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.440607 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":282,"threads_started":1}
I20260810 18:37:12.442165 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.422938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46747 (local address 127.13.139.3:50703)
0810 18:37:12.423701 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:12.423766 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:12.425777 (+ 2011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:12.426517 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:12.426526 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:12.426964 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:37:12.427697 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.427715 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.428915 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.428920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.430385 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.430397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.431202 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.431210 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.431512 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.432138 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:37:12.432161 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:37:12.434297 (+ 2136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:37:12.437622 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:37:12.437631 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:37:12.437646 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:37:12.438182 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:37:12.438566 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:37:12.438572 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:37:12.438575 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:37:12.438797 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:37:12.439328 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:37:12.439337 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:37:12.439930 (+ 593us) client_negotiation.cc:769] Sending connection context
0810 18:37:12.440262 (+ 332us) client_negotiation.cc:240] Negotiation successful
0810 18:37:12.440804 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":291,"threads_started":1}
I20260810 18:37:12.443832 27045 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46747
I20260810 18:37:12.444104 27045 heartbeater.cc:464] Registering TS with master...
I20260810 18:37:12.444782 27045 heartbeater.cc:511] Master 127.13.139.62:46747 requested a full tablet report, sending...
I20260810 18:37:12.446172 26501 ts_manager.cc:194] Registered new tserver with Master: b54ada8ce4664a53bfcc8a60909987c4 (127.13.139.3:33927)
I20260810 18:37:12.447005 26501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:50703
I20260810 18:37:12.455397 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:37:12.473377 27047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.460102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52838 (local address 127.13.139.62:46747)
0810 18:37:12.460253 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.460257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.460767 (+ 510us) server_negotiation.cc:407] Connection header received
0810 18:37:12.461037 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.461043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.461123 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.461228 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:12.462799 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.463647 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.464947 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.465358 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.465499 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.467831 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:12.467835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:12.467838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:12.467869 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:12.470588 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.471296 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.471308 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.471311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.471576 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.471963 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.471970 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.471975 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.472239 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:12.472526 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.472807 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.473052 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:37:12.477330 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:37:12.485134 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:37:12.523275 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.498714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46786 (local address 127.13.139.1:43901)
0810 18:37:12.513782 (+ 15068us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.513792 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.513848 (+ 56us) server_negotiation.cc:407] Connection header received
0810 18:37:12.513975 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.513985 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.514290 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.515532 (+ 1242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:37:12.515845 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.517509 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.520251 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.521774 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.522004 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.522391 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.522577 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.522738 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14886,"thread_start_us":14713,"threads_started":1}
I20260810 18:37:12.523310 27061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.498537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43901 (local address 127.0.0.1:46786)
0810 18:37:12.499472 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:12.499510 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:12.499689 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:12.514618 (+ 14929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:12.514626 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:12.514663 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:37:12.515257 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.515280 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.517705 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.517711 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.520080 (+ 2369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.520094 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.522055 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.522061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.522272 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.522366 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 18:37:12.522529 (+ 163us) client_negotiation.cc:240] Negotiation successful
0810 18:37:12.522725 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":42,"thread_start_us":15163,"threads_started":1}
I20260810 18:37:12.524611 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.498724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:41729 (local address 127.0.0.1:37896)
0810 18:37:12.512877 (+ 14153us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:12.512908 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:12.513106 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:12.516623 (+ 3517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:12.516630 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:12.516666 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:37:12.517153 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.517167 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.518958 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.518963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.521484 (+ 2521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.521498 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.523650 (+ 2152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.523658 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.523850 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.523884 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 18:37:12.523970 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 18:37:12.524156 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13945,"mutex_wait_us":60,"thread_start_us":748,"threads_started":1}
I20260810 18:37:12.525501 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.500588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60468 (local address 127.13.139.3:33927)
0810 18:37:12.514640 (+ 14052us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.514648 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.515532 (+ 884us) server_negotiation.cc:407] Connection header received
0810 18:37:12.515669 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.515679 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.515979 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.516168 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:37:12.517001 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.518615 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.521614 (+ 2999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.523230 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.523357 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.523640 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.524889 (+ 1249us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.525064 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13870,"thread_start_us":14095,"threads_started":1}
I20260810 18:37:12.525473 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.499286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37896 (local address 127.13.139.2:41729)
0810 18:37:12.516063 (+ 16777us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.516071 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.516098 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:37:12.516186 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.516193 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.516418 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.516610 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:37:12.517341 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.518759 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.521670 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.523230 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.524047 (+ 817us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.524319 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.524382 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.524553 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16588,"thread_start_us":16464,"threads_started":1}
I20260810 18:37:12.524753 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.500228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:33927 (local address 127.0.0.1:60468)
0810 18:37:12.515365 (+ 15137us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:12.515384 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:12.515527 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:12.516173 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:12.516177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:12.516201 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:37:12.516693 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.516708 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.518771 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.518776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.521412 (+ 2636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.521428 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.523781 (+ 2353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.523787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.523950 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.524099 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 18:37:12.524195 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 18:37:12.524318 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15006,"mutex_wait_us":107,"thread_start_us":14820,"threads_started":1}
I20260810 18:37:12.528028 26661 tablet_service.cc:1467] Processing CreateTablet for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c (DEFAULT_TABLE table=test-table [id=811621fe19ac4046b532acb21bbbad21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:37:12.529320 26661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:37:12.529332 26817 tablet_service.cc:1467] Processing CreateTablet for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c (DEFAULT_TABLE table=test-table [id=811621fe19ac4046b532acb21bbbad21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:37:12.530639 26817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:37:12.538110 26972 tablet_service.cc:1467] Processing CreateTablet for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c (DEFAULT_TABLE table=test-table [id=811621fe19ac4046b532acb21bbbad21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:37:12.539331 26972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:37:12.544963 27066 tablet_bootstrap.cc:492] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Bootstrap starting.
I20260810 18:37:12.548255 27068 tablet_bootstrap.cc:492] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Bootstrap starting.
I20260810 18:37:12.549851 27066 tablet_bootstrap.cc:654] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Neither blocks nor log segments found. Creating new log.
I20260810 18:37:12.550993 27066 log.cc:824] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Log is configured to *not* fsync() on all Append() calls
I20260810 18:37:12.551983 27068 tablet_bootstrap.cc:654] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Neither blocks nor log segments found. Creating new log.
I20260810 18:37:12.552929 27071 tablet_bootstrap.cc:492] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Bootstrap starting.
I20260810 18:37:12.554270 27068 log.cc:824] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Log is configured to *not* fsync() on all Append() calls
I20260810 18:37:12.554342 27066 tablet_bootstrap.cc:492] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: No bootstrap required, opened a new log
I20260810 18:37:12.554679 27066 ts_tablet_manager.cc:1397] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260810 18:37:12.556900 27071 tablet_bootstrap.cc:654] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Neither blocks nor log segments found. Creating new log.
I20260810 18:37:12.557662 27068 tablet_bootstrap.cc:492] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: No bootstrap required, opened a new log
I20260810 18:37:12.557952 27068 ts_tablet_manager.cc:1397] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260810 18:37:12.558084 27071 log.cc:824] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Log is configured to *not* fsync() on all Append() calls
I20260810 18:37:12.561533 27071 tablet_bootstrap.cc:492] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: No bootstrap required, opened a new log
I20260810 18:37:12.561776 27071 ts_tablet_manager.cc:1397] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:37:12.565409 27066 raft_consensus.cc:348] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.565891 27066 raft_consensus.cc:374] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:37:12.566000 27066 raft_consensus.cc:729] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e560ae476240485fa0bbc698a60822d2, State: Initialized, Role: FOLLOWER
I20260810 18:37:12.566635 27066 consensus_queue.cc:260] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.566968 27068 raft_consensus.cc:348] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.567476 27068 raft_consensus.cc:374] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:37:12.567592 27068 raft_consensus.cc:729] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40bdc3fefb854021bf3073774ed1a8bc, State: Initialized, Role: FOLLOWER
I20260810 18:37:12.568251 27068 consensus_queue.cc:260] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.568840 27066 ts_tablet_manager.cc:1428] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
I20260810 18:37:12.569986 26892 heartbeater.cc:503] Master 127.13.139.62:46747 was elected leader, sending a full tablet report...
I20260810 18:37:12.570634 27068 ts_tablet_manager.cc:1428] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Time spent starting tablet: real 0.013s user 0.001s sys 0.010s
I20260810 18:37:12.573069 27071 raft_consensus.cc:348] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.573500 27071 raft_consensus.cc:374] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:37:12.573609 27071 raft_consensus.cc:729] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54ada8ce4664a53bfcc8a60909987c4, State: Initialized, Role: FOLLOWER
I20260810 18:37:12.574203 27071 consensus_queue.cc:260] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.575322 27045 heartbeater.cc:503] Master 127.13.139.62:46747 was elected leader, sending a full tablet report...
I20260810 18:37:12.575892 27071 ts_tablet_manager.cc:1428] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260810 18:37:12.643797 27077 raft_consensus.cc:482] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:37:12.644119 27077 raft_consensus.cc:504] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.645846 27077 leader_election.cc:288] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e560ae476240485fa0bbc698a60822d2 (127.13.139.1:43901), 40bdc3fefb854021bf3073774ed1a8bc (127.13.139.2:41729)
I20260810 18:37:12.653115 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.646295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:41729 (local address 127.13.139.3:38837)
0810 18:37:12.646693 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:12.646709 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:12.646811 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:12.647230 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:12.647235 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:12.647278 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:37:12.647526 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.647539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.649114 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.649117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.651049 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.651064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.652593 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.652597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.652737 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.652760 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:37:12.652831 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 18:37:12.652930 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305}
I20260810 18:37:12.653278 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.646451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:38837 (local address 127.13.139.2:41729)
0810 18:37:12.646667 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.646673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.646813 (+ 140us) server_negotiation.cc:407] Connection header received
0810 18:37:12.646944 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.646952 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.647057 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.647180 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:37:12.647691 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.648994 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.651260 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.652453 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.652619 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.652697 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.652890 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.653018 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:37:12.654170 27078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.646526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43901 (local address 127.13.139.3:53829)
0810 18:37:12.647451 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0810 18:37:12.647470 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:37:12.647587 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:37:12.647925 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:37:12.647928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:37:12.647945 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:37:12.648213 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.648220 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.649683 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.649688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.651639 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:37:12.651650 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.653521 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.653529 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:37:12.653705 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.653748 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 18:37:12.653846 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 18:37:12.653949 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"thread_start_us":504,"threads_started":1}
I20260810 18:37:12.654295 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.646304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:53829 (local address 127.13.139.1:43901)
0810 18:37:12.646524 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.646530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.647556 (+ 1026us) server_negotiation.cc:407] Connection header received
0810 18:37:12.647732 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.647738 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.647817 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.647912 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:37:12.648365 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.649541 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.651805 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.653146 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.653300 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.653380 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.653896 (+ 516us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.654059 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 18:37:12.654312 26839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68fc4d9f3e164a0d901dc5b2b5a8424c" candidate_uuid: "b54ada8ce4664a53bfcc8a60909987c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40bdc3fefb854021bf3073774ed1a8bc" is_pre_election: true
I20260810 18:37:12.654911 26839 raft_consensus.cc:2454] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b54ada8ce4664a53bfcc8a60909987c4 in term 0.
I20260810 18:37:12.655224 26680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68fc4d9f3e164a0d901dc5b2b5a8424c" candidate_uuid: "b54ada8ce4664a53bfcc8a60909987c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e560ae476240485fa0bbc698a60822d2" is_pre_election: true
I20260810 18:37:12.655706 26917 leader_election.cc:302] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40bdc3fefb854021bf3073774ed1a8bc, b54ada8ce4664a53bfcc8a60909987c4; no voters:
I20260810 18:37:12.656085 27077 raft_consensus.cc:2781] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:37:12.656234 27077 raft_consensus.cc:482] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:37:12.656159 26680 raft_consensus.cc:2454] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b54ada8ce4664a53bfcc8a60909987c4 in term 0.
I20260810 18:37:12.656363 27077 raft_consensus.cc:3037] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:37:12.659016 27077 raft_consensus.cc:504] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.659704 27077 leader_election.cc:288] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [CANDIDATE]: Term 1 election: Requested vote from peers e560ae476240485fa0bbc698a60822d2 (127.13.139.1:43901), 40bdc3fefb854021bf3073774ed1a8bc (127.13.139.2:41729)
I20260810 18:37:12.660122 26680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68fc4d9f3e164a0d901dc5b2b5a8424c" candidate_uuid: "b54ada8ce4664a53bfcc8a60909987c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e560ae476240485fa0bbc698a60822d2"
I20260810 18:37:12.660238 26839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68fc4d9f3e164a0d901dc5b2b5a8424c" candidate_uuid: "b54ada8ce4664a53bfcc8a60909987c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40bdc3fefb854021bf3073774ed1a8bc"
I20260810 18:37:12.660341 26680 raft_consensus.cc:3037] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:37:12.660460 26839 raft_consensus.cc:3037] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:37:12.663676 26680 raft_consensus.cc:2454] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b54ada8ce4664a53bfcc8a60909987c4 in term 1.
I20260810 18:37:12.663743 26839 raft_consensus.cc:2454] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b54ada8ce4664a53bfcc8a60909987c4 in term 1.
I20260810 18:37:12.664104 26917 leader_election.cc:302] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40bdc3fefb854021bf3073774ed1a8bc, b54ada8ce4664a53bfcc8a60909987c4; no voters:
I20260810 18:37:12.664402 27077 raft_consensus.cc:2781] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:37:12.664877 27077 raft_consensus.cc:686] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 1 LEADER]: Becoming Leader. State: Replica: b54ada8ce4664a53bfcc8a60909987c4, State: Running, Role: LEADER
I20260810 18:37:12.665356 27077 consensus_queue.cc:237] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } }
I20260810 18:37:12.670455 26500 catalog_manager.cc:5495] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b54ada8ce4664a53bfcc8a60909987c4 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "b54ada8ce4664a53bfcc8a60909987c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b54ada8ce4664a53bfcc8a60909987c4" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 33927 } health_report { overall_health: HEALTHY } } }
W20260810 18:37:12.671798 27046 tablet.cc:2369] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:37:12.713007 26733 tablet.cc:2369] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:37:12.716606 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.711235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60476 (local address 127.13.139.3:33927)
0810 18:37:12.711463 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.711473 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.711559 (+ 86us) server_negotiation.cc:407] Connection header received
0810 18:37:12.711736 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.711739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.711829 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.711954 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:37:12.712253 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.713000 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.714685 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.715068 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.715158 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.715666 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:37:12.716165 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:37:12.716272 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.716346 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.716409 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 18:37:12.724861 26680 raft_consensus.cc:1261] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 1 FOLLOWER]: Refusing update from remote peer b54ada8ce4664a53bfcc8a60909987c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:37:12.724857 26839 raft_consensus.cc:1261] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 1 FOLLOWER]: Refusing update from remote peer b54ada8ce4664a53bfcc8a60909987c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:37:12.725832 27079 consensus_queue.cc:1035] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40bdc3fefb854021bf3073774ed1a8bc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:37:12.726227 27077 consensus_queue.cc:1035] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e560ae476240485fa0bbc698a60822d2" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:37:12.752045 26500 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:37:12.752377 26500 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:37:12.756318 26500 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37a407695e974dee8d7abc6391d60ae8: Sending DeleteTablet for 3 replicas of tablet 68fc4d9f3e164a0d901dc5b2b5a8424c
I20260810 18:37:12.757555 26661 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:37:12 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:46786
I20260810 18:37:12.757771 26817 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:37:12 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:37896
I20260810 18:37:12.758661 27094 tablet_replica.cc:330] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: stopping tablet replica
I20260810 18:37:12.758500 26972 tablet_service.cc:1514] Processing DeleteTablet for tablet 68fc4d9f3e164a0d901dc5b2b5a8424c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:37:12 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:60468
I20260810 18:37:12.759341 27094 raft_consensus.cc:2229] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:37:12.760005 27094 raft_consensus.cc:2258] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:37:12.761032 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 26589
I20260810 18:37:12.768785 27092 tablet_replica.cc:330] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: stopping tablet replica
I20260810 18:37:12.769340 27092 raft_consensus.cc:2229] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:37:12.770046 27092 raft_consensus.cc:2258] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:37:12.771018 27094 ts_tablet_manager.cc:1905] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:37:12.772686 27092 ts_tablet_manager.cc:1905] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:37:12.775902 27095 tablet_replica.cc:330] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: stopping tablet replica
I20260810 18:37:12.776456 27095 raft_consensus.cc:2229] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:37:12.777280 27095 raft_consensus.cc:2258] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:37:12.779527 27095 ts_tablet_manager.cc:1905] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:37:12.780349 27092 ts_tablet_manager.cc:1918] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:37:12.780521 27092 log.cc:1196] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/68fc4d9f3e164a0d901dc5b2b5a8424c
I20260810 18:37:12.781062 27092 ts_tablet_manager.cc:1939] T 68fc4d9f3e164a0d901dc5b2b5a8424c P e560ae476240485fa0bbc698a60822d2: Deleting consensus metadata
I20260810 18:37:12.782974 26486 catalog_manager.cc:4841] TS e560ae476240485fa0bbc698a60822d2 (127.13.139.1:43901): tablet 68fc4d9f3e164a0d901dc5b2b5a8424c (table test-table [id=811621fe19ac4046b532acb21bbbad21]) successfully deleted
I20260810 18:37:12.783318 27094 ts_tablet_manager.cc:1918] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:37:12.784345 27094 log.cc:1196] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/68fc4d9f3e164a0d901dc5b2b5a8424c
I20260810 18:37:12.784994 27094 ts_tablet_manager.cc:1939] T 68fc4d9f3e164a0d901dc5b2b5a8424c P 40bdc3fefb854021bf3073774ed1a8bc: Deleting consensus metadata
I20260810 18:37:12.786868 26483 catalog_manager.cc:4841] TS 40bdc3fefb854021bf3073774ed1a8bc (127.13.139.2:41729): tablet 68fc4d9f3e164a0d901dc5b2b5a8424c (table test-table [id=811621fe19ac4046b532acb21bbbad21]) successfully deleted
I20260810 18:37:12.789075 27095 ts_tablet_manager.cc:1918] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:37:12.789271 27095 log.cc:1196] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/68fc4d9f3e164a0d901dc5b2b5a8424c
I20260810 18:37:12.789860 27095 ts_tablet_manager.cc:1939] T 68fc4d9f3e164a0d901dc5b2b5a8424c P b54ada8ce4664a53bfcc8a60909987c4: Deleting consensus metadata
I20260810 18:37:12.791652 26483 catalog_manager.cc:4841] TS b54ada8ce4664a53bfcc8a60909987c4 (127.13.139.3:33927): tablet 68fc4d9f3e164a0d901dc5b2b5a8424c (table test-table [id=811621fe19ac4046b532acb21bbbad21]) successfully deleted
Aug 10 18:37:12 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:37:12.803251 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.762418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46796 (local address 127.13.139.1:43901)
0810 18:37:12.762611 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.762618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.784016 (+ 21398us) server_negotiation.cc:407] Connection header received
0810 18:37:12.784235 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.784242 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.784341 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.784490 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:12.786087 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.787195 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.789362 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.790179 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.790324 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.795529 (+ 5205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:12.795546 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:12.795565 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:12.795620 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:12.799824 (+ 4204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.800564 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.800574 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.800577 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.800756 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.801143 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.801148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.801152 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.801668 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:12.801970 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.802421 (+ 451us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.802661 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 18:37:12.804651 26726 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:37:12.910882 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 26589
I20260810 18:37:12.940335 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 26738
Aug 10 18:37:12 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:37:12.958176 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:12.941300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37898 (local address 127.13.139.2:41729)
0810 18:37:12.941482 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:12.941486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:12.941505 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:37:12.941649 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:12.941653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:12.941718 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:12.941799 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:12.943534 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.944274 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.946221 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:12.946612 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:12.946708 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:12.951923 (+ 5215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:12.951939 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:12.951954 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:12.951991 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:12.955033 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.955882 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.955889 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.955891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.956023 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:12.956426 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:12.956429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:12.956431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:12.956853 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:12.957068 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:12.957498 (+ 430us) server_negotiation.cc:299] Negotiation successful
0810 18:37:12.957714 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 18:37:12.958972 26886 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:37:13.050416 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 26738
I20260810 18:37:13.073177 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 26900
Aug 10 18:37:13 dist-test-slave-5k54 krb5kdc[25968](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:37:13.091786 27064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:37:13.074087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60478 (local address 127.13.139.3:33927)
0810 18:37:13.074315 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:37:13.074320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:37:13.074398 (+ 78us) server_negotiation.cc:407] Connection header received
0810 18:37:13.074626 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:37:13.074630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:37:13.074718 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:37:13.074796 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:37:13.076778 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:13.077506 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:13.079503 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:37:13.080024 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:37:13.080128 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:37:13.085453 (+ 5325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:37:13.085465 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:37:13.085484 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:37:13.085537 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:37:13.088711 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:13.089484 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:13.089498 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:13.089500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:13.089652 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:37:13.090063 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:37:13.090069 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:37:13.090073 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:37:13.090438 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:37:13.090770 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0810 18:37:13.091047 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 18:37:13.091289 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 18:37:13.092525 27039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:37:13.216588 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 26900
I20260810 18:37:13.239652 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 26464
I20260810 18:37:13.240831 26534 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:37:13.353327 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 26464
I20260810 18:37:13.378054 13868 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 18:37:13.723033 13868 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 18:37:13.723371 13868 mini_ranger.cc:66] Stopping Ranger...
I20260810 18:37:14.068754 13868 mini_ranger.cc:68] Stopped Ranger
2026-08-10 18:37:14.069 UTC [26002] LOG: received smart shutdown request
2026-08-10 18:37:14.072 UTC [26002] LOG: background worker "logical replication launcher" (PID 26011) exited with exit code 1
2026-08-10 18:37:14.073 UTC [26006] LOG: shutting down
2026-08-10 18:37:14.252 UTC [26002] LOG: database system is shut down
2026-08-10T18:37:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50947 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:37:14 dist-test-slave-5k54 krb5kdc[27111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:37:14 dist-test-slave-5k54 krb5kdc[27111](info): set up 2 sockets
Aug 10 18:37:14 dist-test-slave-5k54 krb5kdc[27111](info): commencing operation
krb5kdc: starting...
W20260810 18:37:15.583145 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:37:15 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:37:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:37:15Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/rangeradmin_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/rangeradmin_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/rangerlookup_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/rangerlookup_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
I20260810 18:37:15.958315 13868 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task4ILylI/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/postgres -l logfile start
2026-08-10 18:37:18.435 UTC [27141] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 18:37:18.435 UTC [27141] LOG: listening on IPv4 address "127.13.139.20", port 56439
2026-08-10 18:37:18.438 UTC [27141] LOG: listening on Unix socket "/tmp/.s.PGSQL.56439"
2026-08-10 18:37:18.462 UTC [27145] LOG: database system was shut down at 2026-08-10 18:37:17 UTC
2026-08-10 18:37:18.465 UTC [27141] LOG: database system is ready to accept connections
I20260810 18:37:19.511525 13868 mini_postgres.cc:96] Postgres bound to 56439
2026-08-10 18:37:19.534 UTC [27153] FATAL: database "slave" does not exist
127.13.139.20:56439 - accepting connections
I20260810 18:37:19.535091 13868 mini_ranger.cc:161] Starting Ranger...
I20260810 18:37:19.565303 13868 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 18:37:20.065232 13868 mini_ranger.cc:87] Created ranger Postgres database
I20260810 18:37:20.065330 13868 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-admin
2026-08-10 18:37:20,368 [I] DB FLAVOR :POSTGRES
2026-08-10 18:37:20,368 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 18:37:20,368 [I] Checking connection..
2026-08-10 18:37:20,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 18:37:20,624 [I] Checking connection passed.
2026-08-10 18:37:20,625 [I] --------- Verifying version history table ---------
2026-08-10 18:37:20,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 18:37:20,910 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 18:37:20,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 18:37:21,164 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 18:37:21,165 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 18:37:21,165 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 18:37:21.401 UTC [27227] WARNING: there is no transaction in progress
2026-08-10 18:37:21,408 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 18:37:21,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 18:37:21,669 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 18:37:21,670 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 18:37:21,670 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 18:37:21,937 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 18:37:22,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-5k54.c.gcp-upstream.internal','N') ;"
2026-08-10 18:37:22,455 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 18:37:22,750 [I] Table x_portal_user does not exist in database ranger
2026-08-10 18:37:22,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 18:37:22,998 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 18:37:22,999 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 18:37:23,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 18:37:23,501 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 18:37:23,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 18:37:24.479 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.499 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.516 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.531 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.546 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.564 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.627 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.634 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.649 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.660 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.671 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.684 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.694 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.700 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.707 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:24.714 UTC [27347] WARNING: there is no transaction in progress
2026-08-10 18:37:25,353 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 18:37:25,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 18:37:25,603 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 18:37:25,604 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 18:37:25,865 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 18:37:25,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 18:37:26,121 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 18:37:26,121 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 18:37:26,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 18:37:26,644 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-5k54.c.gcp-upstream.internal';"
2026-08-10 18:37:26,906 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 18:37:26,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 18:37:27,157 [I] DB_PATCHES have already been applied
I20260810 18:37:27.163407 13868 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-admin:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task4ILylI/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 18:37:27.163569 13868 mini_ranger.cc:193] Using host: 127.13.139.20
I20260810 18:37:27.182981 13868 mini_ranger.cc:227] Ranger admin URL: http://127.13.139.20:51891
Aug 10, 2026 6:37:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:37:27 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:37:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 6:37:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 6:37:27 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 6:37:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 6:37:28 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 18:37:28.499349 13868 mini_ranger.cc:160] Time spent starting Ranger: real 8.964s user 0.001s sys 0.053s
Aug 10, 2026 6:37:49 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 6:37:49 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 6:37:49 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 6:37:49 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 6:37:50 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 18:37:51.008847 13868 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.139.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.139.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/rangerkms_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.139.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/rangerkms_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.139.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.139.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.139.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/HTTP_127.13.139.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 18:37:51 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387071, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 18:37:51.223768 13868 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 18:37:51.247555 13868 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 18:37:52.079934 13868 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 18:37:52.080075 13868 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms
I20260810 18:37:52.080132 13868 mini_ranger_kms.cc:227] Using postgres at 127.13.139.20:56439
2026-08-10 18:37:52,454 [I] DB FLAVOR :POSTGRES
2026-08-10 18:37:52,455 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 18:37:52,455 [I] Checking connection
2026-08-10 18:37:52,455 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 18:37:52,701 [I] connection success
2026-08-10 18:37:52,702 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 18:37:52,702 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 18:37:52,702 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 18:37:52,965 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 18:37:52,965 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 18:37:52,965 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 18:37:52,965 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.139.20:56439/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 18:37:53,239 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 18:37:53.713274 13868 mini_ranger_kms.cc:310] Created kms service
I20260810 18:37:53.929993 13868 mini_ranger_kms.cc:326] Created kudu user
I20260810 18:37:53.975584 13868 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 18:37:53 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387071, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:37:54.419103 13868 mini_ranger_kms.cc:384] Added ranger policy
I20260810 18:37:54.419493 13868 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms:/tmp/dist-test-task4ILylI/build/asan/bin/postgresql.jar:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task4ILylI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 18:37:54.419559 13868 mini_ranger_kms.cc:240] Using host: 127.13.139.20
I20260810 18:37:54.440570 13868 mini_ranger_kms.cc:276] Ranger KMS PID: 27548
I20260810 18:37:54.440711 13868 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.139.20:39511
Aug 10, 2026 6:37:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:37:55 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:37:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 6:37:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 6:37:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 6:37:55 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 18:37:56 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786387076, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.139.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:37:56.904670 13868 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.681s user 0.058s sys 0.340s
I20260810 18:37:56.904947 13868 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 18:37:56.905130 13868 mini_ranger_kms.cc:401] 127.13.139.20:39511/kms/v1/keys
Aug 10 18:37:57 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387076, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.139.20@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
Aug 10 18:37:57 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387076, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.139.20@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
Aug 10 18:37:59 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:37:59.828118 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44159
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:44159
--ranger_config_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:00.184618 27608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:00.185026 27608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:00.185184 27608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:00.192603 27608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:00.192711 27608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:00.192807 27608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:00.192896 27608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:00.192967 27608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:00.203158 27608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.139.20:39511/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:44159
--ranger_config_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:00.204517 27608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:00.205883 27608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:00.217737 27613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:00.217782 27615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:00.217821 27617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:00.218611 27608 server_base.cc:1034] running on GCE node
I20260810 18:38:00.219404 27608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:00.220928 27608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:00.222127 27608 hybrid_clock.cc:648] HybridClock initialized: now 1786387080222092 us; error 31 us; skew 500 ppm
I20260810 18:38:00.222489 27608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:00 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387080, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:00.225693 27608 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:00.227131 27608 webserver.cc:460] Webserver started at http://127.13.139.62:34919/ using document root <none> and password file <none>
I20260810 18:38:00.227851 27608 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:00.227993 27608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:00.228300 27608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:38:00 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387080, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:00.280052 27608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "9ab5c986275b4e0887ecb77742416877"
format_stamp: "Formatted at 2026-08-10 18:38:00 on dist-test-slave-5k54"
server_key: "39dcffbf8b2346169db3971b7f67492a"
server_key_iv: "b0e35d3a07151f52a9148893ba38defe"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:00.280959 27608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "9ab5c986275b4e0887ecb77742416877"
format_stamp: "Formatted at 2026-08-10 18:38:00 on dist-test-slave-5k54"
server_key: "39dcffbf8b2346169db3971b7f67492a"
server_key_iv: "b0e35d3a07151f52a9148893ba38defe"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:00.287073 27608 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260810 18:38:00.304266 27624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:00.305876 27608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:00.306072 27608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "9ab5c986275b4e0887ecb77742416877"
format_stamp: "Formatted at 2026-08-10 18:38:00 on dist-test-slave-5k54"
server_key: "39dcffbf8b2346169db3971b7f67492a"
server_key_iv: "b0e35d3a07151f52a9148893ba38defe"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:00.306315 27608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:00.347287 27608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:00.351157 27608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:00.351544 27608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:00.370216 27608 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:44159
I20260810 18:38:00.370249 27679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:44159 every 8 connection(s)
I20260810 18:38:00.371635 27608 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:00.375326 27681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:00.379769 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 27608
I20260810 18:38:00.380004 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:38:00.380681 13868 external_mini_cluster.cc:1428] Setting key 13f6d595a1096c3cb799bd31554d6300
I20260810 18:38:00.386215 27681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Bootstrap starting.
I20260810 18:38:00.389935 27681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:00.391165 27681 log.cc:824] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:00.394063 27681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: No bootstrap required, opened a new log
Aug 10 18:38:00 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:00.403702 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:00.382633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60468 (local address 127.13.139.62:44159)
0810 18:38:00.383505 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:00.383517 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:00.383563 (+ 46us) server_negotiation.cc:407] Connection header received
0810 18:38:00.385238 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:00.385259 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:00.385677 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:00.385987 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:00.387725 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:00.389023 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:00.390899 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:00.391810 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:00.392046 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:00.396403 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:00.396410 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:00.396427 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:00.396472 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:00.399604 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:00.400434 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:00.400453 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:00.400459 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:00.400596 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:00.401003 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:00.401006 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:00.401008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:00.401561 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:00.401777 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:00.402265 (+ 488us) server_negotiation.cc:299] Negotiation successful
0810 18:38:00.402631 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":375,"threads_started":1}
I20260810 18:38:00.403458 27681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:00.403929 27681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:00.404066 27681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab5c986275b4e0887ecb77742416877, State: Initialized, Role: FOLLOWER
I20260810 18:38:00.404706 27681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:00.404969 27681 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:38:00.405128 27681 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:38:00.405306 27681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:00.407779 27681 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:00.408237 27681 leader_election.cc:302] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ab5c986275b4e0887ecb77742416877; no voters:
I20260810 18:38:00.408812 27681 leader_election.cc:288] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:38:00.408954 27686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:00.409703 27686 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab5c986275b4e0887ecb77742416877, State: Running, Role: LEADER
I20260810 18:38:00.410246 27686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:00.410945 27681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:00.414067 27688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ab5c986275b4e0887ecb77742416877. Latest consensus state: current_term: 1 leader_uuid: "9ab5c986275b4e0887ecb77742416877" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } } }
I20260810 18:38:00.414439 27688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:00.415102 27687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ab5c986275b4e0887ecb77742416877" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } } }
I20260810 18:38:00.415551 27687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:00.420892 27696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:00.421214 27681 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 18:38:00.433758 27696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:00.446578 27696 catalog_manager.cc:1347] Generated new cluster ID: 2e5ea221b34046db8f3b7ba75b26fe29
I20260810 18:38:00.446714 27696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:38:00.466574 27696 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:38:00.468607 27696 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:38:00.488690 27696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Generated new TSK 0
I20260810 18:38:00.489717 27696 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:38:01.280566 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44159
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:38:01 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786387081, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 18:38:01.715579 27730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:01.715976 27730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:01.716179 27730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:01.727787 27730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:01.727999 27730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:01.728236 27730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:38:01.743996 27730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.139.20:39511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:01.745718 27730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:01.747411 27730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:01.774834 27741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:01.776397 27742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:01.778017 27730 server_base.cc:1034] running on GCE node
W20260810 18:38:01.778332 27744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:01.779129 27730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:01.781287 27730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:01.782588 27730 hybrid_clock.cc:648] HybridClock initialized: now 1786387081782500 us; error 61 us; skew 500 ppm
I20260810 18:38:01.783028 27730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:01 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387081, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:01.786788 27730 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:38:01.790294 27730 webserver.cc:460] Webserver started at http://127.13.139.1:43135/ using document root <none> and password file <none>
I20260810 18:38:01.791292 27730 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:01.791538 27730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:01.791872 27730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:38:01 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387081, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:01.810935 27730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "75aea3ee454b44bf95600671eda2b746"
format_stamp: "Formatted at 2026-08-10 18:38:01 on dist-test-slave-5k54"
server_key: "89771d8a7d670b15aaec9a60d6b7343e"
server_key_iv: "9e5c552eac527d66b394f1ecfd186c6f"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:01.812240 27730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "75aea3ee454b44bf95600671eda2b746"
format_stamp: "Formatted at 2026-08-10 18:38:01 on dist-test-slave-5k54"
server_key: "89771d8a7d670b15aaec9a60d6b7343e"
server_key_iv: "9e5c552eac527d66b394f1ecfd186c6f"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:01.819298 27730 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260810 18:38:01.836668 27751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:01.838251 27730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:38:01.838451 27730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "75aea3ee454b44bf95600671eda2b746"
format_stamp: "Formatted at 2026-08-10 18:38:01 on dist-test-slave-5k54"
server_key: "89771d8a7d670b15aaec9a60d6b7343e"
server_key_iv: "9e5c552eac527d66b394f1ecfd186c6f"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:01.838686 27730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:01.871410 27730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:01.875679 27730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:01.876025 27730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:01.878865 27730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:01.880573 27730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:01.880676 27730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:01.880802 27730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:01.880882 27730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:01.963781 27730 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:42673
I20260810 18:38:01.963946 27882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:42673 every 8 connection(s)
I20260810 18:38:01.965631 27730 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:38:01.967010 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 27730
I20260810 18:38:01.967265 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:38:01.968320 13868 external_mini_cluster.cc:1428] Setting key a35d37a0574d213f80c6b04afc9d1e14
Aug 10 18:38:02 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387081, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:02.030474 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:01.969354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44159 (local address 127.13.139.1:42479)
0810 18:38:01.984212 (+ 14858us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:01.984294 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:01.988472 (+ 4178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:01.999658 (+ 11186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:01.999672 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:02.000465 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:02.001491 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:02.001515 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:02.002766 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:02.002771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:02.004903 (+ 2132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:02.004919 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:02.006212 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:02.006219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:02.006532 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:02.007393 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:02.007467 (+ 74us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:02.010588 (+ 3121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:02.025538 (+ 14950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:02.025550 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:02.025572 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:02.026239 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:02.026722 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:02.026727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:02.026731 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:02.026993 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:02.027728 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:02.027738 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:02.028193 (+ 455us) client_negotiation.cc:769] Sending connection context
0810 18:38:02.028499 (+ 306us) client_negotiation.cc:240] Negotiation successful
0810 18:38:02.029059 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14381,"thread_start_us":17302,"threads_started":1}
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
I20260810 18:38:02.033124 27885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:01.968671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:42479 (local address 127.13.139.62:44159)
0810 18:38:01.998831 (+ 30160us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:01.998838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:01.998864 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:38:01.998937 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:01.998943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:01.999064 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:02.001673 (+ 2609us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:02.001834 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:02.002584 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:02.005109 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:02.005752 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:02.005871 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:02.010994 (+ 5123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:02.011029 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:02.011035 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:02.011089 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:02.025357 (+ 14268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:02.026416 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:02.026422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:02.026426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:02.026585 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:02.027144 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:02.027149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:02.027152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:02.027575 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:02.032563 (+ 4988us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:02.032671 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 18:38:02.032851 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30008,"thread_start_us":32562,"threads_started":1}
I20260810 18:38:02.034765 27883 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44159
I20260810 18:38:02.035107 27883 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
I20260810 18:38:02.036027 27883 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
I20260810 18:38:02.038676 27641 ts_manager.cc:194] Registered new tserver with Master: 75aea3ee454b44bf95600671eda2b746 (127.13.139.1:42673)
I20260810 18:38:02.040740 27641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:42479
Aug 10 18:38:02 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387081, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
W20260810 18:38:02.074756 13868 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.13.139.2: real 0.103s user 0.005s sys 0.022s
I20260810 18:38:02.075846 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44159
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:38:02 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387081, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
W20260810 18:38:02.621842 27889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:02.622331 27889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:02.622522 27889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:02.632505 27889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:02.632735 27889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:02.633023 27889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:38:02.649379 27889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.139.20:39511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:02.651690 27889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:02.653594 27889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:02.693889 27901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:02.694707 27889 server_base.cc:1034] running on GCE node
W20260810 18:38:02.695325 27898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:02.695767 27896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:02.696708 27889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:02.704128 27889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:02.705704 27889 hybrid_clock.cc:648] HybridClock initialized: now 1786387082705569 us; error 129 us; skew 500 ppm
I20260810 18:38:02.706244 27889 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:02 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387082, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:02.712483 27889 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:38:02.734490 27889 webserver.cc:460] Webserver started at http://127.13.139.2:37955/ using document root <none> and password file <none>
I20260810 18:38:02.735810 27889 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:02.736100 27889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:02.736562 27889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:38:02 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387082, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:02.765738 27889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "56f6eed1c4b0448e9b23d234244fb7c3"
format_stamp: "Formatted at 2026-08-10 18:38:02 on dist-test-slave-5k54"
server_key: "dc4e84454b8eb4accf07e04db549fa02"
server_key_iv: "9c192e0ec73f4f624d273b2b7d95abd8"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:02.772900 27889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "56f6eed1c4b0448e9b23d234244fb7c3"
format_stamp: "Formatted at 2026-08-10 18:38:02 on dist-test-slave-5k54"
server_key: "dc4e84454b8eb4accf07e04db549fa02"
server_key_iv: "9c192e0ec73f4f624d273b2b7d95abd8"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:02.796862 27889 fs_manager.cc:691] Time spent creating directory manager: real 0.021s user 0.002s sys 0.004s
I20260810 18:38:02.838140 27907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:02.840464 27889 fs_manager.cc:725] Time spent opening block manager: real 0.023s user 0.006s sys 0.009s
I20260810 18:38:02.840773 27889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "56f6eed1c4b0448e9b23d234244fb7c3"
format_stamp: "Formatted at 2026-08-10 18:38:02 on dist-test-slave-5k54"
server_key: "dc4e84454b8eb4accf07e04db549fa02"
server_key_iv: "9c192e0ec73f4f624d273b2b7d95abd8"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:02.841174 27889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:02.921386 27889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:02.926795 27889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:02.927224 27889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:02.928664 27889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:02.936796 27889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:02.936918 27889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:02.937062 27889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:02.937134 27889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:03.010687 27889 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:40013
I20260810 18:38:03.010725 28039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:40013 every 8 connection(s)
I20260810 18:38:03.012359 27889 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:38:03.020757 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 27889
I20260810 18:38:03.021005 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:38:03.021767 13868 external_mini_cluster.cc:1428] Setting key f664ae6f61a49e86e52dca679f63d028
I20260810 18:38:03.044516 27883 heartbeater.cc:503] Master 127.13.139.62:44159 was elected leader, sending a full tablet report...
Aug 10 18:38:03 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387082, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:03.055692 28043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:03.016589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44159 (local address 127.13.139.2:44737)
0810 18:38:03.024080 (+ 7491us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:03.024137 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:03.026667 (+ 2530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:03.036260 (+ 9593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:03.036273 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:03.036926 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:03.037741 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:03.037791 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.039349 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.039354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:03.041233 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:03.041248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.042279 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.042286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:03.042567 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:03.043550 (+ 983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:03.043579 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:03.046717 (+ 3138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:03.050921 (+ 4204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:03.050929 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:03.050948 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:03.051551 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:03.052000 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:03.052005 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:03.052008 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:03.052257 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:03.052930 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:03.052938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:03.053401 (+ 463us) client_negotiation.cc:769] Sending connection context
0810 18:38:03.053690 (+ 289us) client_negotiation.cc:240] Negotiation successful
0810 18:38:03.054246 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7128,"thread_start_us":14665,"threads_started":1}
I20260810 18:38:03.057583 28044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:03.017305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:44737 (local address 127.13.139.62:44159)
0810 18:38:03.027405 (+ 10100us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:03.027411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:03.027449 (+ 38us) server_negotiation.cc:407] Connection header received
0810 18:38:03.027503 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:03.027509 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:03.027592 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:03.027686 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:03.037971 (+ 10285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.039168 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.041410 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.042052 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.042203 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:03.046980 (+ 4777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:03.046987 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:03.046992 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:03.047033 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:03.050768 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.051713 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.051719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.051722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.051870 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.052419 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.052423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.052427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.052779 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:03.056836 (+ 4057us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:03.056978 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 18:38:03.057208 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9966,"thread_start_us":15204,"threads_started":1}
I20260810 18:38:03.059724 28040 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44159
I20260810 18:38:03.060057 28040 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:03.060899 28040 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
I20260810 18:38:03.062621 27641 ts_manager.cc:194] Registered new tserver with Master: 56f6eed1c4b0448e9b23d234244fb7c3 (127.13.139.2:40013)
I20260810 18:38:03.063766 27641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:44737
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:38:03.111498 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44159
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:03.449536 28047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:03.449819 28047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:03.450016 28047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:03.457172 28047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:03.457300 28047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:03.457481 28047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:38:03.467181 28047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.139.20:39511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:03.468469 28047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:03.469743 28047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:03.482582 28052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:03.483170 28053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:03.483521 28055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:03.484104 28047 server_base.cc:1034] running on GCE node
I20260810 18:38:03.484709 28047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:03.485736 28047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:03.487025 28047 hybrid_clock.cc:648] HybridClock initialized: now 1786387083486961 us; error 45 us; skew 500 ppm
I20260810 18:38:03.487303 28047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:03 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387083, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:03.490633 28047 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:38:03.492076 28047 webserver.cc:460] Webserver started at http://127.13.139.3:42543/ using document root <none> and password file <none>
I20260810 18:38:03.492694 28047 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:03.492792 28047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:03.493039 28047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 18:38:03 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387083, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:03.509478 28047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "419046637bd1449b9b3ac67097fd9774"
format_stamp: "Formatted at 2026-08-10 18:38:03 on dist-test-slave-5k54"
server_key: "554f61933dc64a03b0d6c979b99813ff"
server_key_iv: "b35ecda18ad50a9b73f06408c1f252e0"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:03.510735 28047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "419046637bd1449b9b3ac67097fd9774"
format_stamp: "Formatted at 2026-08-10 18:38:03 on dist-test-slave-5k54"
server_key: "554f61933dc64a03b0d6c979b99813ff"
server_key_iv: "b35ecda18ad50a9b73f06408c1f252e0"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:03.517974 28047 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260810 18:38:03.532548 28062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:03.534178 28047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:38:03.534366 28047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "419046637bd1449b9b3ac67097fd9774"
format_stamp: "Formatted at 2026-08-10 18:38:03 on dist-test-slave-5k54"
server_key: "554f61933dc64a03b0d6c979b99813ff"
server_key_iv: "b35ecda18ad50a9b73f06408c1f252e0"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:03.534600 28047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:03.576336 28047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:03.580602 28047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:03.580917 28047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:03.581931 28047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:03.583339 28047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:03.583460 28047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:03.583617 28047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:03.583688 28047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:03.617309 28047 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:44103
I20260810 18:38:03.617347 28190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:44103 every 8 connection(s)
I20260810 18:38:03.618629 28047 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:38:03.620487 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 28047
I20260810 18:38:03.620682 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:38:03.621374 13868 external_mini_cluster.cc:1428] Setting key 7f654bb917ec60299afce35393b239d5
Aug 10 18:38:03 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387083, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:03.639533 28194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:03.621314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:46495 (local address 127.13.139.62:44159)
0810 18:38:03.621827 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:03.621832 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:03.623121 (+ 1289us) server_negotiation.cc:407] Connection header received
0810 18:38:03.625451 (+ 2330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:03.625456 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:03.625548 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:03.625656 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:03.627074 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.627852 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.629382 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.629790 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.629919 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:03.633178 (+ 3259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:03.633183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:03.633186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:03.633222 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:03.636057 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.637080 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.637084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.637086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.637215 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.637639 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.637643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.637645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.637945 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:03.638126 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:03.638861 (+ 735us) server_negotiation.cc:299] Negotiation successful
0810 18:38:03.639087 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":268,"threads_started":1}
I20260810 18:38:03.640475 28195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:03.622063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44159 (local address 127.13.139.3:46495)
0810 18:38:03.622968 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:03.623023 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:03.625198 (+ 2175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:03.625898 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:03.625906 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:03.626344 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:03.626908 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:03.626933 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.628001 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.628006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:03.629236 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:03.629247 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.630020 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.630028 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:03.630249 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:03.630890 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:03.630933 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:03.632986 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:03.636187 (+ 3201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:03.636196 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:03.636211 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:03.636788 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:03.637314 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:03.637317 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:03.637320 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:03.637546 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:03.638100 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:03.638108 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:03.638487 (+ 379us) client_negotiation.cc:769] Sending connection context
0810 18:38:03.638779 (+ 292us) client_negotiation.cc:240] Negotiation successful
0810 18:38:03.639286 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":365,"threads_started":1}
I20260810 18:38:03.641712 28191 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44159
I20260810 18:38:03.642017 28191 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:03.642658 28191 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
I20260810 18:38:03.644070 27641 ts_manager.cc:194] Registered new tserver with Master: 419046637bd1449b9b3ac67097fd9774 (127.13.139.3:44103)
I20260810 18:38:03.644824 27641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:46495
I20260810 18:38:03.649025 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:38:03.650753 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 27730
Aug 10 18:38:03 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:38:03.666811 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:03.651711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41700 (local address 127.13.139.1:42673)
0810 18:38:03.652341 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:03.652347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:03.652370 (+ 23us) server_negotiation.cc:407] Connection header received
0810 18:38:03.652438 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:03.652444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:03.652616 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:03.652737 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:03.654139 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.655141 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.656644 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.657133 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.657227 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:03.661607 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:03.661617 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:03.661629 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:03.661659 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:03.664527 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.665179 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.665185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.665187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.665325 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.665644 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.665647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.665649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.665957 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:03.666196 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:03.666365 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 18:38:03.666545 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":345,"threads_started":1}
I20260810 18:38:03.668104 27877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:03.752023 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 27730
I20260810 18:38:03.771934 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 27889
Aug 10 18:38:03 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:38:03.796111 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:03.777489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39090 (local address 127.13.139.2:40013)
0810 18:38:03.778067 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:03.778075 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:03.778101 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:38:03.778161 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:03.778167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:03.778393 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:03.778538 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:03.779823 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.780854 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.782144 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.782683 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.782780 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:03.790773 (+ 7993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:03.790784 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:03.790799 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:03.790832 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:03.793539 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.794149 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.794155 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.794157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.794280 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.794582 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.794585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.794586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.794895 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:03.795125 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:03.795376 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 18:38:03.795697 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":323,"threads_started":1}
I20260810 18:38:03.797327 28034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:03.880774 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 27889
I20260810 18:38:03.900893 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 28047
Aug 10 18:38:03 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:38:03.919896 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:03.902002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52218 (local address 127.13.139.3:44103)
0810 18:38:03.902680 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:03.902687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:03.902717 (+ 30us) server_negotiation.cc:407] Connection header received
0810 18:38:03.902780 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:03.902786 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:03.903014 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:03.903156 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:03.904491 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.905538 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.906718 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:03.907317 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:03.907411 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:03.912023 (+ 4612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:03.912033 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:03.912048 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:03.912080 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:03.916114 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.917087 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.917096 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.917099 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.917281 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:03.917752 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:03.917757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:03.917760 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:03.918303 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:03.918647 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:03.919034 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 18:38:03.919349 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":368,"threads_started":1}
I20260810 18:38:03.921485 28186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:04.019881 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 28047
I20260810 18:38:04.038785 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 27608
I20260810 18:38:04.040096 27674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:04.148346 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 27608
I20260810 18:38:04.177101 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44159
--webserver_interface=127.13.139.62
--webserver_port=34919
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:44159
--ranger_config_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:04.508276 28204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:04.508616 28204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:04.508776 28204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:04.515928 28204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:04.516083 28204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:04.516182 28204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:04.516283 28204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:04.516368 28204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:04.526890 28204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:44159
--ranger_config_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=34919
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:04.528266 28204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:04.529598 28204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:04.541393 28210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:04.541366 28209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:04.541453 28214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:04.542443 28204 server_base.cc:1034] running on GCE node
I20260810 18:38:04.543184 28204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:04.544617 28204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:04.545841 28204 hybrid_clock.cc:648] HybridClock initialized: now 1786387084545793 us; error 55 us; skew 500 ppm
I20260810 18:38:04.546192 28204 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:04 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387084, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:04.549225 28204 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:04.550611 28204 webserver.cc:460] Webserver started at http://127.13.139.62:34919/ using document root <none> and password file <none>
I20260810 18:38:04.551244 28204 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:04.551393 28204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 18:38:04 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387084, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:04.598023 28204 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 18:38:04.601240 28222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:04.602694 28204 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260810 18:38:04.602862 28204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "9ab5c986275b4e0887ecb77742416877"
format_stamp: "Formatted at 2026-08-10 18:38:00 on dist-test-slave-5k54"
server_key: "39dcffbf8b2346169db3971b7f67492a"
server_key_iv: "b0e35d3a07151f52a9148893ba38defe"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:04.603978 28204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:04.621752 28204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:04.625341 28204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:04.625636 28204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:04.644515 28204 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:44159
I20260810 18:38:04.644550 28282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:44159 every 8 connection(s)
I20260810 18:38:04.646009 28204 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:04.652842 28283 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:38:04.653013 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 28204
I20260810 18:38:04.654111 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:42673
--local_ip_for_outbound_sockets=127.13.139.1
--tserver_master_addrs=127.13.139.62:44159
--webserver_port=43135
--webserver_interface=127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:38:04.657876 28283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Bootstrap starting.
I20260810 18:38:04.678565 28283 log.cc:824] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:04.687363 28283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:38:04.687932 28283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Bootstrap complete.
I20260810 18:38:04.696818 28283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:04.697633 28283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab5c986275b4e0887ecb77742416877, State: Initialized, Role: FOLLOWER
I20260810 18:38:04.698247 28283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:04.698473 28283 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:38:04.698581 28283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:38:04.698734 28283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 1 FOLLOWER]: Advancing to term 2
I20260810 18:38:04.702687 28283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:04.703383 28283 leader_election.cc:302] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ab5c986275b4e0887ecb77742416877; no voters:
I20260810 18:38:04.704109 28283 leader_election.cc:288] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 18:38:04.704246 28287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 18:38:04.706454 28283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:04.707747 28287 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab5c986275b4e0887ecb77742416877, State: Running, Role: LEADER
I20260810 18:38:04.708621 28287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } }
I20260810 18:38:04.711892 28289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ab5c986275b4e0887ecb77742416877. Latest consensus state: current_term: 2 leader_uuid: "9ab5c986275b4e0887ecb77742416877" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } } }
I20260810 18:38:04.712376 28289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:04.712960 28288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9ab5c986275b4e0887ecb77742416877" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab5c986275b4e0887ecb77742416877" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44159 } } }
I20260810 18:38:04.713224 28288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877 [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:04.723973 28298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:04.730243 28298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:04.731057 28283 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 18:38:04.731858 28298 catalog_manager.cc:1259] Loaded cluster ID: 2e5ea221b34046db8f3b7ba75b26fe29
I20260810 18:38:04.732024 28298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:38:04.745118 28298 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:38:04.748255 28298 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Loaded TSK: 0
I20260810 18:38:04.750401 28298 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 18:38:05.101114 28285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:05.101558 28285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:05.101774 28285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:05.113838 28285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:05.114084 28285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:05.114326 28285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:38:05.130538 28285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:42673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=43135
--tserver_master_addrs=127.13.139.62:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:05.132400 28285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:05.134225 28285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:05.163683 28327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:05.166265 28326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:05.170137 28330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:05.170194 28285 server_base.cc:1034] running on GCE node
I20260810 18:38:05.171123 28285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:05.173744 28285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:05.175053 28285 hybrid_clock.cc:648] HybridClock initialized: now 1786387085174988 us; error 68 us; skew 500 ppm
I20260810 18:38:05.175539 28285 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:05 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387085, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:05.185390 28285 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:38:05.192499 28285 webserver.cc:460] Webserver started at http://127.13.139.1:43135/ using document root <none> and password file <none>
I20260810 18:38:05.193691 28285 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:05.193946 28285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 18:38:05 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387085, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:05.252096 28285 fs_manager.cc:709] Time spent opening directory manager: real 0.021s user 0.011s sys 0.001s
I20260810 18:38:05.263263 28338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:05.265365 28285 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.005s
I20260810 18:38:05.265623 28285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "75aea3ee454b44bf95600671eda2b746"
format_stamp: "Formatted at 2026-08-10 18:38:01 on dist-test-slave-5k54"
server_key: "89771d8a7d670b15aaec9a60d6b7343e"
server_key_iv: "9e5c552eac527d66b394f1ecfd186c6f"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:05.267110 28285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:05.305476 28285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:05.310544 28285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:05.310854 28285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:05.312144 28285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:05.313995 28285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:05.314122 28285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:05.314255 28285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:05.314375 28285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:05.389958 28285 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:42673
I20260810 18:38:05.390007 28468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:42673 every 8 connection(s)
I20260810 18:38:05.391731 28285 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:38:05.396564 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 28285
I20260810 18:38:05.397640 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:40013
--local_ip_for_outbound_sockets=127.13.139.2
--tserver_master_addrs=127.13.139.62:44159
--webserver_port=37955
--webserver_interface=127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:38:05 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387085, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:05.452184 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:05.395562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:48941 (local address 127.13.139.62:44159)
0810 18:38:05.419203 (+ 23641us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:05.419220 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:05.419260 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:38:05.419705 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:05.419719 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:05.420106 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:05.420492 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:05.422170 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:05.423636 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:05.426044 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:05.427106 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:05.427338 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:05.431214 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:05.431223 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:05.431240 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:05.431284 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:05.437849 (+ 6565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:05.447785 (+ 9936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:05.447795 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:05.447803 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:05.448012 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:05.448602 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:05.448608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:05.448613 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:05.449280 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:05.449492 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:05.450395 (+ 903us) server_negotiation.cc:299] Negotiation successful
0810 18:38:05.450807 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23377,"thread_start_us":23734,"threads_started":1}
I20260810 18:38:05.452193 28472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:05.395608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44159 (local address 127.13.139.1:48941)
0810 18:38:05.416216 (+ 20608us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:05.416285 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:05.418398 (+ 2113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:05.420653 (+ 2255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:05.420666 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:05.421358 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:05.421942 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:05.421970 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:05.423858 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:05.423864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:05.425413 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:05.425433 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:05.427381 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:05.427391 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:05.427732 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:05.428575 (+ 843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:05.428600 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:05.430918 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:05.438080 (+ 7162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:05.438091 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:05.438110 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:05.446587 (+ 8477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:05.448176 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:05.448182 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:05.448186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:05.448451 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:05.449441 (+ 990us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:05.449450 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:05.449842 (+ 392us) client_negotiation.cc:769] Sending connection context
0810 18:38:05.450132 (+ 290us) client_negotiation.cc:240] Negotiation successful
0810 18:38:05.450777 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20284,"thread_start_us":20048,"threads_started":1}
I20260810 18:38:05.456007 28469 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44159
I20260810 18:38:05.456367 28469 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:05.457116 28469 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
W20260810 18:38:05.460265 28469 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:44159 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 18:38:05.460517 28469 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:05.460834 28469 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
I20260810 18:38:05.461972 28469 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:05.462244 28469 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
W20260810 18:38:05.463289 28469 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 18:38:05.858400 28473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:05.858697 28473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:05.858865 28473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:05.868434 28473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:05.868593 28473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:05.868844 28473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:38:05.884750 28473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:40013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=37955
--tserver_master_addrs=127.13.139.62:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:05.886483 28473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:05.888186 28473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:05.906922 28489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:05.908062 28490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:05.910151 28493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:05.911168 28473 server_base.cc:1034] running on GCE node
I20260810 18:38:05.912098 28473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:05.923748 28473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:05.925683 28473 hybrid_clock.cc:648] HybridClock initialized: now 1786387085925567 us; error 126 us; skew 500 ppm
I20260810 18:38:05.926187 28473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:05 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387085, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:05.930742 28473 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:38:05.939750 28473 webserver.cc:460] Webserver started at http://127.13.139.2:37955/ using document root <none> and password file <none>
I20260810 18:38:05.940815 28473 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:05.940994 28473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 18:38:05 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387085, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:05.977468 28473 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:38:05.981313 28503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:05.983249 28473 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260810 18:38:05.983529 28473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "56f6eed1c4b0448e9b23d234244fb7c3"
format_stamp: "Formatted at 2026-08-10 18:38:02 on dist-test-slave-5k54"
server_key: "dc4e84454b8eb4accf07e04db549fa02"
server_key_iv: "9c192e0ec73f4f624d273b2b7d95abd8"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:05.985126 28473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:06.008674 28473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:06.014896 28473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:06.015288 28473 kserver.cc:163] Server-wide thread pool size limit: 3276
Aug 10 18:38:06 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786387086, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:06.019372 28473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:06.021238 28473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:06.021356 28473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:06.021483 28473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:06.021579 28473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:06.120244 28473 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:40013
I20260810 18:38:06.120316 28628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:40013 every 8 connection(s)
I20260810 18:38:06.122313 28473 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:38:06.123368 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 28473
I20260810 18:38:06.124244 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.139.20:39511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:44103
--local_ip_for_outbound_sockets=127.13.139.3
--tserver_master_addrs=127.13.139.62:44159
--webserver_port=42543
--webserver_interface=127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:38:06 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387085, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:06.159777 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:06.134434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:49585 (local address 127.13.139.62:44159)
0810 18:38:06.141126 (+ 6692us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:06.141132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:06.141165 (+ 33us) server_negotiation.cc:407] Connection header received
0810 18:38:06.144113 (+ 2948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:06.144120 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:06.144210 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:06.144280 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:06.146012 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.146787 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.148808 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.149256 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.149404 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:06.153247 (+ 3843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:06.153253 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:06.153257 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:06.153291 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:06.156176 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.157209 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.157215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.157219 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.157381 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.157882 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.157888 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.157891 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.158191 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:06.158373 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:06.159121 (+ 748us) server_negotiation.cc:299] Negotiation successful
0810 18:38:06.159370 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6552,"thread_start_us":6410,"threads_started":1}
I20260810 18:38:06.160887 28631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:06.133726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44159 (local address 127.13.139.2:49585)
0810 18:38:06.140266 (+ 6540us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:06.140347 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:06.143733 (+ 3386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:06.144726 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:06.144734 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:06.145237 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:06.145812 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:06.145835 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.146961 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.146966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:06.148642 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:06.148655 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.149496 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.149507 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:06.149804 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:06.150622 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:06.150653 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:06.152997 (+ 2344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:06.156344 (+ 3347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:06.156353 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:06.156386 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:06.157037 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:06.157513 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:06.157520 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:06.157526 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:06.157749 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:06.158329 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:06.158338 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:06.158715 (+ 377us) client_negotiation.cc:769] Sending connection context
0810 18:38:06.158988 (+ 273us) client_negotiation.cc:240] Negotiation successful
0810 18:38:06.159592 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6107,"thread_start_us":5823,"threads_started":1}
I20260810 18:38:06.162799 28629 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44159
I20260810 18:38:06.163147 28629 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:06.164146 28629 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
I20260810 18:38:06.166484 28242 ts_manager.cc:194] Registered new tserver with Master: 56f6eed1c4b0448e9b23d234244fb7c3 (127.13.139.2:40013)
I20260810 18:38:06.168771 28242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:49585
Aug 10 18:38:06 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387086, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:06.464047 28469 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:06.464555 28469 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
I20260810 18:38:06.466012 28242 ts_manager.cc:194] Registered new tserver with Master: 75aea3ee454b44bf95600671eda2b746 (127.13.139.1:42673)
I20260810 18:38:06.467242 28242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:48941
W20260810 18:38:06.594681 28633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:06.595021 28633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:06.595196 28633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:06.603288 28633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:06.603430 28633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:06.603665 28633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:38:06.614521 28633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.139.20:39511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:44103
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=42543
--tserver_master_addrs=127.13.139.62:44159
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:06.615968 28633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:06.617642 28633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:06.635587 28638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:06.636417 28640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:06.653156 28642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:06.656226 28633 server_base.cc:1034] running on GCE node
I20260810 18:38:06.657043 28633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:06.658187 28633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:06.659590 28633 hybrid_clock.cc:648] HybridClock initialized: now 1786387086659509 us; error 62 us; skew 500 ppm
I20260810 18:38:06.659937 28633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:06 dist-test-slave-5k54 krb5kdc[27111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387086, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:06.663549 28633 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:38:06.665469 28633 webserver.cc:460] Webserver started at http://127.13.139.3:42543/ using document root <none> and password file <none>
I20260810 18:38:06.666189 28633 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:06.666348 28633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 18:38:06 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387086, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:06.691761 28633 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.008s sys 0.000s
I20260810 18:38:06.694947 28651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:06.696524 28633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:06.696720 28633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "419046637bd1449b9b3ac67097fd9774"
format_stamp: "Formatted at 2026-08-10 18:38:03 on dist-test-slave-5k54"
server_key: "554f61933dc64a03b0d6c979b99813ff"
server_key_iv: "b35ecda18ad50a9b73f06408c1f252e0"
server_key_version: "kuduclusterkey@0"
I20260810 18:38:06.697748 28633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:06.735940 28633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:06.740368 28633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:06.740756 28633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:06.742024 28633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:06.743630 28633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:06.743754 28633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:06.743896 28633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:06.743990 28633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 18:38:06 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387086, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for HTTP/127.13.139.20@KRBTEST.COM
I20260810 18:38:06.870903 28783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:44103 every 8 connection(s)
I20260810 18:38:06.880030 28633 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:44103
I20260810 18:38:06.882207 28633 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:38:06.887778 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 28633
I20260810 18:38:06.925349 28785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:06.889058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37142 (local address 127.13.139.62:44159)
0810 18:38:06.905709 (+ 16651us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:06.905715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:06.905737 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:38:06.905814 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:06.905820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:06.905913 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:06.906033 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:06.908868 (+ 2835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.909965 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.913157 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.913857 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.913987 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:06.917961 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:06.917969 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:06.917974 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:06.918024 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:06.921871 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.922716 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.922721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.922725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.922895 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.923367 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.923372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.923376 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.923772 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:06.924053 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:06.924677 (+ 624us) server_negotiation.cc:299] Negotiation successful
0810 18:38:06.924951 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16521,"thread_start_us":16410,"threads_started":1}
Aug 10 18:38:06 dist-test-slave-5k54 krb5kdc[27111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387086, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:06.945358 28789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:06.907635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44159 (local address 127.13.139.3:33137)
0810 18:38:06.908573 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:06.908630 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:06.912452 (+ 3822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:06.921967 (+ 9515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:06.921980 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:06.922652 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:06.923600 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:06.923627 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.925302 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.925308 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:06.927379 (+ 2071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:06.927395 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.928702 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.928710 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:06.928995 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:06.930918 (+ 1923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:06.930953 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:06.934020 (+ 3067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:06.938128 (+ 4108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:06.938138 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:06.938158 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:06.938815 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:06.939355 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:06.939362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:06.939365 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:06.939684 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:06.940453 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:06.940462 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:06.940917 (+ 455us) client_negotiation.cc:769] Sending connection context
0810 18:38:06.941247 (+ 330us) client_negotiation.cc:240] Negotiation successful
0810 18:38:06.942226 (+ 979us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":609,"threads_started":1}
I20260810 18:38:06.946537 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:06.908192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:33137 (local address 127.13.139.62:44159)
0810 18:38:06.921392 (+ 13200us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:06.921396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:06.921412 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:38:06.921452 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:06.921456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:06.921524 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:06.921666 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:06.923867 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.925111 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.927603 (+ 2492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.928272 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.928387 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:06.934327 (+ 5940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:06.934334 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:06.934339 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:06.934378 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:06.937943 (+ 3565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.938986 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.938991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.938994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.939140 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.939833 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.939838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.939841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.940204 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:06.940353 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:06.945899 (+ 5546us) server_negotiation.cc:299] Negotiation successful
0810 18:38:06.946137 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13088,"thread_start_us":13648,"threads_started":1}
I20260810 18:38:06.948684 28784 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44159
I20260810 18:38:06.949038 28784 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:06.949899 28784 heartbeater.cc:511] Master 127.13.139.62:44159 requested a full tablet report, sending...
I20260810 18:38:06.951646 28242 ts_manager.cc:194] Registered new tserver with Master: 419046637bd1449b9b3ac67097fd9774 (127.13.139.3:44103)
I20260810 18:38:06.952769 28242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:33137
I20260810 18:38:06.957679 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:38:06.993456 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:06.972412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37152 (local address 127.13.139.62:44159)
0810 18:38:06.972599 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:06.972606 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:06.976054 (+ 3448us) server_negotiation.cc:407] Connection header received
0810 18:38:06.976250 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:06.976255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:06.976343 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:06.976465 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:06.978590 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.979800 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.981833 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:06.982499 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:06.982633 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:06.986288 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:06.986295 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:06.986301 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:06.986345 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:06.989959 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.990875 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.990883 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.990887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.991050 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:06.991588 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:06.991594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:06.991597 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:06.991964 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:06.992180 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:06.992858 (+ 678us) server_negotiation.cc:299] Negotiation successful
0810 18:38:06.993092 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 18:38:07.001225 28242 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:38:07.012952 28242 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:38:07.089646 28802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.045361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:40013 (local address 127.0.0.1:59212)
0810 18:38:07.057861 (+ 12500us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.057881 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:07.071442 (+ 13561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:07.074461 (+ 3019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:07.074467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:07.074495 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:07.075389 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.075408 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.077994 (+ 2586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.078003 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.082463 (+ 4460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.082488 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.088655 (+ 6167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.088661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.088873 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.088930 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 18:38:07.089061 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 18:38:07.089267 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12373,"thread_start_us":10345,"threads_started":1}
I20260810 18:38:07.090970 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.045554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59212 (local address 127.13.139.2:40013)
0810 18:38:07.073555 (+ 28001us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.073565 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.073599 (+ 34us) server_negotiation.cc:407] Connection header received
0810 18:38:07.073703 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.073711 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.073986 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.074768 (+ 782us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:07.075659 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.077763 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.082723 (+ 4960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.084852 (+ 2129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.085034 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.085337 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.090440 (+ 5103us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.090638 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27804,"thread_start_us":28581,"threads_started":1}
I20260810 18:38:07.091667 28804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.044117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:44103 (local address 127.0.0.1:42060)
0810 18:38:07.055192 (+ 11075us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.055244 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:07.055484 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:07.068565 (+ 13081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:07.068578 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:07.068623 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:07.070675 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.070696 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.085438 (+ 14742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.085447 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.088374 (+ 2927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.088388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.090754 (+ 2366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.090761 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.091040 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.091135 (+ 95us) client_negotiation.cc:769] Sending connection context
0810 18:38:07.091219 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 18:38:07.091351 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10731,"thread_start_us":13491,"threads_started":1}
I20260810 18:38:07.092571 28803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.044910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.13.139.3:44103)
0810 18:38:07.067174 (+ 22264us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.067187 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.067236 (+ 49us) server_negotiation.cc:407] Connection header received
0810 18:38:07.067404 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.067418 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.067803 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.068065 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:07.073004 (+ 4939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.085005 (+ 12001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.088544 (+ 3539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.090211 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.090360 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.090592 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.092029 (+ 1437us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.092209 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22042,"thread_start_us":21888,"threads_started":1}
I20260810 18:38:07.095549 28557 tablet_service.cc:1467] Processing CreateTablet for tablet ed9d31289dec4fddb4527cd6431fda2d (DEFAULT_TABLE table=test-table [id=a7f3763941ef41819e908e2e515aa6c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:07.095899 28706 tablet_service.cc:1467] Processing CreateTablet for tablet ed9d31289dec4fddb4527cd6431fda2d (DEFAULT_TABLE table=test-table [id=a7f3763941ef41819e908e2e515aa6c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:07.097069 28706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed9d31289dec4fddb4527cd6431fda2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:07.097065 28557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed9d31289dec4fddb4527cd6431fda2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:07.109647 28806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.058020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56760)
0810 18:38:07.086950 (+ 28930us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.086971 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:07.099323 (+ 12352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:07.100329 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:07.100334 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:07.100364 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:07.100653 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.100664 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.104052 (+ 3388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.104057 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.106113 (+ 2056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.106129 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.108789 (+ 2660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.108796 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.108986 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.109020 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 18:38:07.109115 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 18:38:07.109258 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28767,"thread_start_us":28585,"threads_started":1}
I20260810 18:38:07.110550 28807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.058288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56760 (local address 127.13.139.1:42673)
0810 18:38:07.086238 (+ 27950us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.086249 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.087113 (+ 864us) server_negotiation.cc:407] Connection header received
0810 18:38:07.099599 (+ 12486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.099608 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.099858 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.100033 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:07.100879 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.103866 (+ 2987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.106307 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.108197 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.108349 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.108588 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.110001 (+ 1413us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.110185 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27740,"thread_start_us":27924,"threads_started":1}
I20260810 18:38:07.115168 28392 tablet_service.cc:1467] Processing CreateTablet for tablet ed9d31289dec4fddb4527cd6431fda2d (DEFAULT_TABLE table=test-table [id=a7f3763941ef41819e908e2e515aa6c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:07.116852 28392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed9d31289dec4fddb4527cd6431fda2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:07.133701 28808 tablet_bootstrap.cc:492] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Bootstrap starting.
I20260810 18:38:07.139621 28808 tablet_bootstrap.cc:654] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:07.143260 28808 log.cc:824] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:07.144994 28809 tablet_bootstrap.cc:492] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Bootstrap starting.
I20260810 18:38:07.150041 28809 tablet_bootstrap.cc:654] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:07.154603 28808 tablet_bootstrap.cc:492] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: No bootstrap required, opened a new log
I20260810 18:38:07.155067 28808 ts_tablet_manager.cc:1397] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.010s
I20260810 18:38:07.155721 28811 tablet_bootstrap.cc:492] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Bootstrap starting.
I20260810 18:38:07.156358 28809 log.cc:824] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:07.159904 28811 tablet_bootstrap.cc:654] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:07.161245 28811 log.cc:824] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:07.169076 28809 tablet_bootstrap.cc:492] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: No bootstrap required, opened a new log
I20260810 18:38:07.169382 28809 ts_tablet_manager.cc:1397] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.008s
I20260810 18:38:07.170460 28808 raft_consensus.cc:348] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.170902 28808 raft_consensus.cc:374] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:07.171010 28808 raft_consensus.cc:729] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 419046637bd1449b9b3ac67097fd9774, State: Initialized, Role: FOLLOWER
I20260810 18:38:07.171663 28808 consensus_queue.cc:260] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.172832 28784 heartbeater.cc:503] Master 127.13.139.62:44159 was elected leader, sending a full tablet report...
I20260810 18:38:07.173388 28808 ts_tablet_manager.cc:1428] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Time spent starting tablet: real 0.018s user 0.014s sys 0.001s
I20260810 18:38:07.173830 28629 heartbeater.cc:503] Master 127.13.139.62:44159 was elected leader, sending a full tablet report...
I20260810 18:38:07.176353 28811 tablet_bootstrap.cc:492] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: No bootstrap required, opened a new log
I20260810 18:38:07.176638 28811 ts_tablet_manager.cc:1397] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.001s
I20260810 18:38:07.179886 28809 raft_consensus.cc:348] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.180323 28809 raft_consensus.cc:374] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:07.180419 28809 raft_consensus.cc:729] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f6eed1c4b0448e9b23d234244fb7c3, State: Initialized, Role: FOLLOWER
I20260810 18:38:07.181007 28809 consensus_queue.cc:260] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.182647 28809 ts_tablet_manager.cc:1428] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Time spent starting tablet: real 0.013s user 0.012s sys 0.002s
I20260810 18:38:07.185627 28811 raft_consensus.cc:348] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.186102 28811 raft_consensus.cc:374] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:07.186221 28811 raft_consensus.cc:729] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75aea3ee454b44bf95600671eda2b746, State: Initialized, Role: FOLLOWER
I20260810 18:38:07.186736 28811 consensus_queue.cc:260] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.187714 28469 heartbeater.cc:503] Master 127.13.139.62:44159 was elected leader, sending a full tablet report...
I20260810 18:38:07.188314 28811 ts_tablet_manager.cc:1428] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Time spent starting tablet: real 0.012s user 0.005s sys 0.007s
W20260810 18:38:07.394404 28630 tablet.cc:2369] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:38:07.402213 28470 tablet.cc:2369] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:38:07.420643 28788 tablet.cc:2369] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:38:07.458221 28822 raft_consensus.cc:482] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:38:07.458583 28822 raft_consensus.cc:504] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.460491 28822 leader_election.cc:288] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 419046637bd1449b9b3ac67097fd9774 (127.13.139.3:44103), 75aea3ee454b44bf95600671eda2b746 (127.13.139.1:42673)
I20260810 18:38:07.468843 28803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.460960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:59513 (local address 127.13.139.3:44103)
0810 18:38:07.461144 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.461148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.461818 (+ 670us) server_negotiation.cc:407] Connection header received
0810 18:38:07.462033 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.462038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.462123 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.462238 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:07.463080 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.464099 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.466603 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.467830 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.468017 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.468111 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.468446 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.468595 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 18:38:07.468868 28807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.462139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:50353 (local address 127.13.139.1:42673)
0810 18:38:07.462365 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.462373 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.462576 (+ 203us) server_negotiation.cc:407] Connection header received
0810 18:38:07.462779 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.462783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.462845 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.462922 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:07.463492 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.464439 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.466747 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.467999 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.468142 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.468201 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.468523 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.468652 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260810 18:38:07.469018 28824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.460938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:44103 (local address 127.13.139.2:59513)
0810 18:38:07.461696 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.461716 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:07.461861 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:07.462410 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:07.462415 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:07.462453 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:07.462916 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.462931 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.464221 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.464225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.466454 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.466469 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.468047 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.468070 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.468270 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.468313 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 18:38:07.468410 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 18:38:07.468571 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":396,"threads_started":1}
I20260810 18:38:07.469241 28825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.461799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.13.139.2:50353)
0810 18:38:07.462471 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.462489 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:07.462630 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:07.462966 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:07.462973 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:07.463005 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:07.463288 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.463296 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.464560 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.464565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.466628 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:07.466637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.468201 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.468207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:07.468364 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.468404 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 18:38:07.468480 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 18:38:07.468579 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":383,"threads_started":1}
I20260810 18:38:07.470134 28730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d31289dec4fddb4527cd6431fda2d" candidate_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419046637bd1449b9b3ac67097fd9774" is_pre_election: true
I20260810 18:38:07.470181 28417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d31289dec4fddb4527cd6431fda2d" candidate_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75aea3ee454b44bf95600671eda2b746" is_pre_election: true
I20260810 18:38:07.470633 28730 raft_consensus.cc:2454] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f6eed1c4b0448e9b23d234244fb7c3 in term 0.
I20260810 18:38:07.470736 28417 raft_consensus.cc:2454] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56f6eed1c4b0448e9b23d234244fb7c3 in term 0.
I20260810 18:38:07.471313 28507 leader_election.cc:302] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 419046637bd1449b9b3ac67097fd9774, 56f6eed1c4b0448e9b23d234244fb7c3; no voters:
I20260810 18:38:07.471740 28822 raft_consensus.cc:2781] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:38:07.471897 28822 raft_consensus.cc:482] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:38:07.472007 28822 raft_consensus.cc:3037] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:07.474139 28822 raft_consensus.cc:504] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.474727 28822 leader_election.cc:288] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [CANDIDATE]: Term 1 election: Requested vote from peers 419046637bd1449b9b3ac67097fd9774 (127.13.139.3:44103), 75aea3ee454b44bf95600671eda2b746 (127.13.139.1:42673)
I20260810 18:38:07.475255 28730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d31289dec4fddb4527cd6431fda2d" candidate_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419046637bd1449b9b3ac67097fd9774"
I20260810 18:38:07.475277 28417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed9d31289dec4fddb4527cd6431fda2d" candidate_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75aea3ee454b44bf95600671eda2b746"
I20260810 18:38:07.475500 28730 raft_consensus.cc:3037] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:07.475500 28417 raft_consensus.cc:3037] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:07.477726 28730 raft_consensus.cc:2454] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f6eed1c4b0448e9b23d234244fb7c3 in term 1.
I20260810 18:38:07.477793 28417 raft_consensus.cc:2454] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56f6eed1c4b0448e9b23d234244fb7c3 in term 1.
I20260810 18:38:07.478138 28507 leader_election.cc:302] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 419046637bd1449b9b3ac67097fd9774, 56f6eed1c4b0448e9b23d234244fb7c3; no voters:
I20260810 18:38:07.478456 28822 raft_consensus.cc:2781] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:07.478912 28822 raft_consensus.cc:686] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 1 LEADER]: Becoming Leader. State: Replica: 56f6eed1c4b0448e9b23d234244fb7c3, State: Running, Role: LEADER
I20260810 18:38:07.479382 28822 consensus_queue.cc:237] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } }
I20260810 18:38:07.484218 28241 catalog_manager.cc:5495] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56f6eed1c4b0448e9b23d234244fb7c3 (127.13.139.2). New cstate: current_term: 1 leader_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56f6eed1c4b0448e9b23d234244fb7c3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 40013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 } health_report { overall_health: UNKNOWN } } }
I20260810 18:38:07.528105 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.522684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59226 (local address 127.13.139.2:40013)
0810 18:38:07.522882 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.522886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.523180 (+ 294us) server_negotiation.cc:407] Connection header received
0810 18:38:07.523351 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.523354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.523472 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.523602 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:38:07.523972 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.524761 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.526130 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.526525 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.526619 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.527086 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:38:07.527627 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:38:07.527754 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.527799 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.527869 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:38:07.536409 28417 raft_consensus.cc:1261] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 1 FOLLOWER]: Refusing update from remote peer 56f6eed1c4b0448e9b23d234244fb7c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:07.536439 28730 raft_consensus.cc:1261] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 1 FOLLOWER]: Refusing update from remote peer 56f6eed1c4b0448e9b23d234244fb7c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:07.537421 28826 consensus_queue.cc:1035] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "419046637bd1449b9b3ac67097fd9774" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:07.537781 28822 consensus_queue.cc:1035] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75aea3ee454b44bf95600671eda2b746" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:07.549223 28830 mvcc.cc:205] Tried to move back new op lower bound from 7317041510538960896 to 7317041510319681536. Current Snapshot: MvccSnapshot[applied={T|T < 7317041510538960896}]
I20260810 18:38:07.562695 28242 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:07.563000 28242 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:07.566459 28242 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ab5c986275b4e0887ecb77742416877: Sending DeleteTablet for 3 replicas of tablet ed9d31289dec4fddb4527cd6431fda2d
I20260810 18:38:07.567675 28557 tablet_service.cc:1514] Processing DeleteTablet for tablet ed9d31289dec4fddb4527cd6431fda2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:07 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:59212
I20260810 18:38:07.568001 28706 tablet_service.cc:1514] Processing DeleteTablet for tablet ed9d31289dec4fddb4527cd6431fda2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:07 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:42060
I20260810 18:38:07.568712 28392 tablet_service.cc:1514] Processing DeleteTablet for tablet ed9d31289dec4fddb4527cd6431fda2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:07 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:56760
I20260810 18:38:07.571058 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 28285
I20260810 18:38:07.592921 28842 tablet_replica.cc:330] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: stopping tablet replica
I20260810 18:38:07.593616 28842 raft_consensus.cc:2229] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:07.594323 28841 tablet_replica.cc:330] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: stopping tablet replica
I20260810 18:38:07.594924 28842 raft_consensus.cc:2258] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:07.595482 28841 raft_consensus.cc:2229] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:07.596349 28841 raft_consensus.cc:2258] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:07.598502 28842 ts_tablet_manager.cc:1905] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:07.600363 28841 ts_tablet_manager.cc:1905] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:07.606298 28807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.572093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56774 (local address 127.13.139.1:42673)
0810 18:38:07.572340 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.572349 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.582866 (+ 10517us) server_negotiation.cc:407] Connection header received
0810 18:38:07.583483 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.583493 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.583608 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.583705 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:07.586321 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.587890 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.590572 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.591502 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.591631 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.596415 (+ 4784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:07.596433 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:07.596458 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:07.596525 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:07.601604 (+ 5079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:07.602797 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:07.602810 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:07.602816 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:07.603051 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:07.603651 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:07.603659 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:07.603665 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:07.604236 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:07.604589 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.605391 (+ 802us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.605698 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:38:07.608557 28840 tablet_replica.cc:330] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: stopping tablet replica
I20260810 18:38:07.608989 28462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:07.612284 28840 raft_consensus.cc:2229] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:38:07.613075 28840 raft_consensus.cc:2258] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:07.614687 28840 ts_tablet_manager.cc:1905] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:07.616289 28841 ts_tablet_manager.cc:1918] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:07.616477 28841 log.cc:1196] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/ed9d31289dec4fddb4527cd6431fda2d
I20260810 18:38:07.617049 28841 ts_tablet_manager.cc:1939] T ed9d31289dec4fddb4527cd6431fda2d P 419046637bd1449b9b3ac67097fd9774: Deleting consensus metadata
I20260810 18:38:07.619014 28227 catalog_manager.cc:4841] TS 419046637bd1449b9b3ac67097fd9774 (127.13.139.3:44103): tablet ed9d31289dec4fddb4527cd6431fda2d (table test-table [id=a7f3763941ef41819e908e2e515aa6c8]) successfully deleted
I20260810 18:38:07.623018 28840 ts_tablet_manager.cc:1918] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:07.623209 28840 log.cc:1196] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/ed9d31289dec4fddb4527cd6431fda2d
I20260810 18:38:07.623829 28840 ts_tablet_manager.cc:1939] T ed9d31289dec4fddb4527cd6431fda2d P 56f6eed1c4b0448e9b23d234244fb7c3: Deleting consensus metadata
I20260810 18:38:07.625877 28223 catalog_manager.cc:4841] TS 56f6eed1c4b0448e9b23d234244fb7c3 (127.13.139.2:40013): tablet ed9d31289dec4fddb4527cd6431fda2d (table test-table [id=a7f3763941ef41819e908e2e515aa6c8]) successfully deleted
I20260810 18:38:07.710397 28842 ts_tablet_manager.cc:1918] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:07.710608 28842 log.cc:1196] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/ed9d31289dec4fddb4527cd6431fda2d
I20260810 18:38:07.711092 28842 ts_tablet_manager.cc:1939] T ed9d31289dec4fddb4527cd6431fda2d P 75aea3ee454b44bf95600671eda2b746: Deleting consensus metadata
I20260810 18:38:07.711593 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 28285
W20260810 18:38:07.739017 28227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:42673 (error 108)
I20260810 18:38:07.739318 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 28473
I20260810 18:38:07.741577 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.740736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56780)
0810 18:38:07.741244 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.741405 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":248,"threads_started":1}
W20260810 18:38:07.741889 28227 catalog_manager.cc:4584] TS 75aea3ee454b44bf95600671eda2b746 (127.13.139.1:42673): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ed9d31289dec4fddb4527cd6431fda2d: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
I20260810 18:38:07.757081 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.740676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59240 (local address 127.13.139.2:40013)
0810 18:38:07.740908 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.740916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.740941 (+ 25us) server_negotiation.cc:407] Connection header received
0810 18:38:07.741016 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.741023 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.741110 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.741217 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:07.743104 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.744126 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.746046 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.746580 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.746681 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.750113 (+ 3432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:07.750128 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:07.750143 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:07.750197 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:07.753739 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:07.754638 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:07.754646 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:07.754648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:07.754797 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:07.755324 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:07.755328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:07.755330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:07.755750 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:07.756060 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.756430 (+ 370us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.756629 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260810 18:38:07.757794 28624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:07.795603 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.794958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56794)
0810 18:38:07.795238 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.795368 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260810 18:38:07.796712 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.796292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56804)
0810 18:38:07.796457 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.796544 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 18:38:07.857523 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.856925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56810)
0810 18:38:07.857211 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.857333 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260810 18:38:07.858700 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.858295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56814)
0810 18:38:07.858458 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.858542 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 18:38:07.877157 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 28473
I20260810 18:38:07.906627 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 28633
I20260810 18:38:07.920020 28803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.907481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.13.139.3:44103)
0810 18:38:07.907663 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:07.907670 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:07.907806 (+ 136us) server_negotiation.cc:407] Connection header received
0810 18:38:07.907951 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:07.907956 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:07.908032 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:07.908141 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:07.909699 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.910456 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.911855 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:07.912262 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:07.912416 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:07.914759 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:07.914770 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:07.914784 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:07.914814 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:07.917482 (+ 2668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:07.918145 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:07.918152 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:07.918154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:07.918268 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:07.918575 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:07.918578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:07.918580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:07.918910 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:07.919129 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:07.919340 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 18:38:07.919755 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 18:38:07.920619 28779 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:07.939343 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.938720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56830)
0810 18:38:07.939006 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.939115 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260810 18:38:07.940551 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:07.940055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56836)
0810 18:38:07.940286 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:07.940376 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260810 18:38:08.010813 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 28633
I20260810 18:38:08.033197 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 28204
I20260810 18:38:08.034416 28278 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:08.148562 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 28204
I20260810 18:38:08.148614 28848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:08.147774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42673 (local address 127.0.0.1:56850)
0810 18:38:08.148103 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:08.148430 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260810 18:38:08.176546 13868 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 18:38:08.521776 13868 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 18:38:08.522064 13868 mini_ranger.cc:66] Stopping Ranger...
I20260810 18:38:08.867236 13868 mini_ranger.cc:68] Stopped Ranger
2026-08-10 18:38:08.867 UTC [27141] LOG: received smart shutdown request
2026-08-10 18:38:08.871 UTC [27141] LOG: background worker "logical replication launcher" (PID 27151) exited with exit code 1
2026-08-10 18:38:08.871 UTC [27146] LOG: shutting down
2026-08-10 18:38:09.050 UTC [27141] LOG: database system is shut down
2026-08-10T18:38:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54795 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:38:09 dist-test-slave-5k54 krb5kdc[28864](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:38:09 dist-test-slave-5k54 krb5kdc[28864](info): set up 2 sockets
Aug 10 18:38:09 dist-test-slave-5k54 krb5kdc[28864](info): commencing operation
krb5kdc: starting...
W20260810 18:38:10.403103 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:38:10 dist-test-slave-5k54 krb5kdc[28864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:38:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:38:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:38:10.673138 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:42269
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:42269,127.13.139.61:41543,127.13.139.60:40547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:11.009344 28879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:11.009634 28879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:11.009732 28879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:11.017114 28879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:11.017238 28879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:11.017285 28879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:11.017352 28879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:11.017397 28879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:11.027205 28879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:42269,127.13.139.61:41543,127.13.139.60:40547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:42269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:11.028561 28879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:11.029863 28879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:11.042928 28885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:11.043102 28888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:11.043071 28886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:11.044076 28879 server_base.cc:1034] running on GCE node
I20260810 18:38:11.044888 28879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:11.046242 28879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:11.047513 28879 hybrid_clock.cc:648] HybridClock initialized: now 1786387091047453 us; error 62 us; skew 500 ppm
I20260810 18:38:11.047899 28879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:11 dist-test-slave-5k54 krb5kdc[28864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:11.055928 28879 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:11.057415 28879 webserver.cc:460] Webserver started at http://127.13.139.62:39451/ using document root <none> and password file <none>
I20260810 18:38:11.058172 28879 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:11.058274 28879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:11.058543 28879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:11.061561 28879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "3466c5ff465b47d882d607097886aa3b"
format_stamp: "Formatted at 2026-08-10 18:38:11 on dist-test-slave-5k54"
server_key: "6c2ebd744275fc8b8a8d0d545425addf"
server_key_iv: "473b70293c42912d39a09733fd70b6f2"
server_key_version: "encryptionkey@0"
I20260810 18:38:11.062350 28879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "3466c5ff465b47d882d607097886aa3b"
format_stamp: "Formatted at 2026-08-10 18:38:11 on dist-test-slave-5k54"
server_key: "6c2ebd744275fc8b8a8d0d545425addf"
server_key_iv: "473b70293c42912d39a09733fd70b6f2"
server_key_version: "encryptionkey@0"
I20260810 18:38:11.067612 28879 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 18:38:11.071092 28897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:11.072481 28879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:11.072664 28879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "3466c5ff465b47d882d607097886aa3b"
format_stamp: "Formatted at 2026-08-10 18:38:11 on dist-test-slave-5k54"
server_key: "6c2ebd744275fc8b8a8d0d545425addf"
server_key_iv: "473b70293c42912d39a09733fd70b6f2"
server_key_version: "encryptionkey@0"
I20260810 18:38:11.072873 28879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:11.095130 28879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:11.099493 28879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:11.099795 28879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:11.119128 28879 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:42269
I20260810 18:38:11.119167 28955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:42269 every 8 connection(s)
I20260810 18:38:11.120528 28879 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:11.124267 28956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:11.129151 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 28879
I20260810 18:38:11.129460 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:38:11.130148 13868 external_mini_cluster.cc:1428] Setting key 4604975e685fd6a1a0a7277e7e0f87f5
I20260810 18:38:11.131057 28956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:38:11 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:11.155370 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.134290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:42269 (local address 127.0.0.1:34200)
0810 18:38:11.135091 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.135129 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:11.137308 (+ 2179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:11.138111 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:11.138117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:11.138816 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:11.139148 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.139165 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.140987 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.140992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.142124 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.142137 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.143568 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.143575 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.143749 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.144430 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:11.144452 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:11.146872 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:11.151338 (+ 4466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.151349 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.151357 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.151837 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.152329 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.152332 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.152334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.152490 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.153543 (+ 1053us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:11.153549 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:11.153729 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 18:38:11.153971 (+ 242us) client_negotiation.cc:240] Negotiation successful
0810 18:38:11.154337 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":2,"thread_start_us":336,"threads_started":1}
I20260810 18:38:11.155476 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.135680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34200 (local address 127.13.139.62:42269)
0810 18:38:11.136472 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:11.136480 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:11.136530 (+ 50us) server_negotiation.cc:407] Connection header received
0810 18:38:11.137671 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:11.137677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:11.137892 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:11.138095 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:11.139359 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.140788 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.142279 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.143267 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.143489 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.147109 (+ 3620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:11.147122 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:11.147140 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:11.147189 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:11.151192 (+ 4003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.151971 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.151981 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.151987 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.152188 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.152630 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.152638 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.152644 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.153379 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:11.153590 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:11.154219 (+ 629us) server_negotiation.cc:299] Negotiation successful
0810 18:38:11.154566 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":567,"thread_start_us":386,"threads_started":1}
WARNING: no policy specified for kudu/127.13.139.61@KRBTEST.COM; defaulting to no policy
I20260810 18:38:11.158638 28956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:38:11.159749 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.159294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50390)
0810 18:38:11.159493 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.159634 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260810 18:38:11.160037 28903 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.61@KRBTEST.COM" created.
I20260810 18:38:11.161648 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.161317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50396)
0810 18:38:11.161455 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.161522 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 18:38:11.161950 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:41543: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab.
Entry for principal kudu/127.13.139.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab.
I20260810 18:38:11.190933 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:41543
--webserver_interface=127.13.139.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab
--principal=kudu/127.13.139.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:42269,127.13.139.61:41543,127.13.139.60:40547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:38:11.211350 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } attempt: 1
I20260810 18:38:11.212807 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.212173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50404)
0810 18:38:11.212436 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.212607 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 18:38:11.213987 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.213529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50412)
0810 18:38:11.213709 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.213806 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 18:38:11.214232 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:41543: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
I20260810 18:38:11.282526 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } attempt: 2
I20260810 18:38:11.283876 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.283244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50420)
0810 18:38:11.283566 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.283688 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 18:38:11.284987 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.284535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50424)
0810 18:38:11.284721 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.284827 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 18:38:11.285190 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:41543: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
I20260810 18:38:11.376521 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } attempt: 3
I20260810 18:38:11.377825 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.377227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50430)
0810 18:38:11.377487 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.377624 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260810 18:38:11.379060 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.378566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50438)
0810 18:38:11.378752 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.378855 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260810 18:38:11.379309 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:41543: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
W20260810 18:38:11.521626 28966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:11.521912 28966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:11.522010 28966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 18:38:11.522585 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } attempt: 4
I20260810 18:38:11.523857 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.523212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50452)
0810 18:38:11.523581 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.523690 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
I20260810 18:38:11.524910 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.524500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50466)
0810 18:38:11.524649 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.524750 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 18:38:11.525122 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:41543: Network error: Client connection negotiation failed: client connection to 127.13.139.61:41543: connect: Connection refused (error 111)
W20260810 18:38:11.530087 28966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:11.530210 28966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:11.530301 28966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:11.530400 28966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:11.530480 28966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:11.540544 28966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:42269,127.13.139.61:41543,127.13.139.60:40547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab
--principal=kudu/127.13.139.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:41543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.139.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:11.541908 28966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:11.543254 28966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:11.555239 28971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:11.555199 28972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:11.555272 28974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:11.556172 28966 server_base.cc:1034] running on GCE node
I20260810 18:38:11.557003 28966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:11.558344 28966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:11.559528 28966 hybrid_clock.cc:648] HybridClock initialized: now 1786387091559480 us; error 50 us; skew 500 ppm
I20260810 18:38:11.559917 28966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:11 dist-test-slave-5k54 krb5kdc[28864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:11.563031 28966 init.cc:377] Logged in from keytab as kudu/127.13.139.61@KRBTEST.COM (short username kudu)
I20260810 18:38:11.564528 28966 webserver.cc:460] Webserver started at http://127.13.139.61:42193/ using document root <none> and password file <none>
I20260810 18:38:11.565222 28966 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:11.565368 28966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:11.565673 28966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:11.568650 28966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data/instance:
uuid: "c7f14e07968040fd88099cb49eff6483"
format_stamp: "Formatted at 2026-08-10 18:38:11 on dist-test-slave-5k54"
server_key: "4089db32540c7276b358cafecb22550c"
server_key_iv: "fe1d69f5619c4fc45a9e3696807da999"
server_key_version: "encryptionkey@0"
I20260810 18:38:11.569458 28966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/wal/instance:
uuid: "c7f14e07968040fd88099cb49eff6483"
format_stamp: "Formatted at 2026-08-10 18:38:11 on dist-test-slave-5k54"
server_key: "4089db32540c7276b358cafecb22550c"
server_key_iv: "fe1d69f5619c4fc45a9e3696807da999"
server_key_version: "encryptionkey@0"
I20260810 18:38:11.575047 28966 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 18:38:11.578445 28983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:11.579831 28966 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 18:38:11.580021 28966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/wal
uuid: "c7f14e07968040fd88099cb49eff6483"
format_stamp: "Formatted at 2026-08-10 18:38:11 on dist-test-slave-5k54"
server_key: "4089db32540c7276b358cafecb22550c"
server_key_iv: "fe1d69f5619c4fc45a9e3696807da999"
server_key_version: "encryptionkey@0"
I20260810 18:38:11.580214 28966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:11.598315 28966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:11.602185 28966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:11.602468 28966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:11.620966 28966 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.61:41543
I20260810 18:38:11.621009 29038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.61:41543 every 8 connection(s)
I20260810 18:38:11.622346 28966 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
I20260810 18:38:11.625399 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 28966
I20260810 18:38:11.625605 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-1/wal/instance
I20260810 18:38:11.626262 13868 external_mini_cluster.cc:1428] Setting key 6aa3f1187e26585c9972e0d4e1087f26
I20260810 18:38:11.626387 29040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:11.636396 29040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:38:11 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.139.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.60@KRBTEST.COM" created.
I20260810 18:38:11.661573 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.639782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34210 (local address 127.13.139.62:42269)
0810 18:38:11.640027 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:11.640036 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:11.641303 (+ 1267us) server_negotiation.cc:407] Connection header received
0810 18:38:11.644277 (+ 2974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:11.644282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:11.644351 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:11.644446 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:11.646677 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.647342 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.649923 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.650334 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.650450 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.655101 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:11.655106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:11.655109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:11.655143 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:11.658030 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.658981 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.658987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.658989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.659154 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.659620 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.659627 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.659633 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.660028 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:11.660202 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:11.660867 (+ 665us) server_negotiation.cc:299] Negotiation successful
0810 18:38:11.661138 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 18:38:11.662173 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.640219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:42269 (local address 127.0.0.1:34210)
0810 18:38:11.641116 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.641165 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:11.643968 (+ 2803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:11.644757 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:11.644787 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:11.645597 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:11.646436 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.646462 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.647563 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.647571 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.649765 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.649783 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.650573 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.650582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.650909 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.651741 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:11.651777 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:11.654840 (+ 3063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:11.658184 (+ 3344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.658191 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.658202 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.658837 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.659267 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.659270 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.659272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.659512 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.660162 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:11.660168 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:11.660473 (+ 305us) client_negotiation.cc:769] Sending connection context
0810 18:38:11.660705 (+ 232us) client_negotiation.cc:240] Negotiation successful
0810 18:38:11.661070 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":391,"threads_started":1}
I20260810 18:38:11.664062 29040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:38:11 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:38:11.680581 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.664876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50478)
0810 18:38:11.665075 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.665097 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:11.665201 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:11.665962 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:11.665974 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:11.666491 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:11.666696 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.666710 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.668609 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.668617 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.669533 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.669544 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.670763 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.670767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.670921 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.671541 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:11.671556 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:11.673679 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:11.678209 (+ 4530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.678213 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.678216 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.678583 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.678997 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.679000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.679002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.679142 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.679921 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:11.679928 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:11.680033 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 18:38:11.680139 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 18:38:11.680324 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 18:38:11.681115 29044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.664966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50478 (local address 127.13.139.61:41543)
0810 18:38:11.665573 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:11.665579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:11.665603 (+ 24us) server_negotiation.cc:407] Connection header received
0810 18:38:11.665644 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:11.665649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:11.665804 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:11.665919 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:11.666904 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.668468 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.669677 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.670607 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.670755 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.673901 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:11.673916 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:11.673935 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:11.673974 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:11.678083 (+ 4109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.678720 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.678731 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.678737 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.678882 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.679248 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.679255 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.679262 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.679791 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:11.680030 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:11.680310 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 18:38:11.680601 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":454,"thread_start_us":324,"threads_started":1}
I20260810 18:38:11.683923 29040 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:38:11.685341 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.684787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51570)
0810 18:38:11.685006 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.685145 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260810 18:38:11.685624 28986 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:11.687211 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.686864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51572)
0810 18:38:11.687001 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.687086 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 18:38:11.687556 29040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab.
Entry for principal kudu/127.13.139.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab.
I20260810 18:38:11.695412 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:40547
--webserver_interface=127.13.139.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab
--principal=kudu/127.13.139.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:42269,127.13.139.61:41543,127.13.139.60:40547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:38:11.736912 29040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 1
I20260810 18:38:11.738188 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.737643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51576)
0810 18:38:11.737869 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.738004 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 18:38:11.739214 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.738831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51586)
0810 18:38:11.739002 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.739085 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 18:38:11.739476 29040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:11.807724 29040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 2
I20260810 18:38:11.808946 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.808416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51600)
0810 18:38:11.808643 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.808756 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 18:38:11.809998 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.809584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51612)
0810 18:38:11.809759 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.809859 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 18:38:11.810230 29040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:11.824396 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } attempt: 5
Aug 10 18:38:11 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:38:11.839010 29044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.825406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50480 (local address 127.13.139.61:41543)
0810 18:38:11.825582 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:11.825586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:11.825604 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:38:11.825671 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:11.825675 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:11.825736 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:11.825820 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:11.826898 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.827662 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.829406 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.829851 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.829968 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.833618 (+ 3650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:11.833623 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:11.833626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:11.833660 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:11.836400 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.837055 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.837062 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.837065 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.837191 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:11.837580 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:11.837586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:11.837589 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:11.837862 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:11.838049 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:11.838456 (+ 407us) server_negotiation.cc:299] Negotiation successful
0810 18:38:11.838669 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:38:11.839010 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.825154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50480)
0810 18:38:11.825374 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.825396 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:11.825541 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:11.825886 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:11.825891 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:11.826426 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:11.826726 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.826741 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.827797 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.827803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.829240 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:11.829260 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:11.830034 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:11.830041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:11.830242 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:11.830916 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:11.830939 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:11.833397 (+ 2458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:11.836548 (+ 3151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.836553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.836557 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.836936 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.837307 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:11.837312 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:11.837316 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:11.837471 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:11.838010 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:11.838015 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:11.838195 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 18:38:11.838348 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 18:38:11.838651 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 18:38:11.840198 28956 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:38:11.841308 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.840901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51616)
0810 18:38:11.841088 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.841174 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260810 18:38:11.842262 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.841942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51632)
0810 18:38:11.842103 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.842170 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 18:38:11.842470 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:11.893693 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 1
I20260810 18:38:11.895128 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.894554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51640)
0810 18:38:11.894763 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.894942 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260810 18:38:11.896267 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.895895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51646)
0810 18:38:11.896050 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.896164 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 18:38:11.896481 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:11.901459 29040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 3
I20260810 18:38:11.902539 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.902056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51648)
0810 18:38:11.902244 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.902353 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 18:38:11.903633 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.903141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51658)
0810 18:38:11.903375 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.903497 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260810 18:38:11.903899 29040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:11.964715 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 2
I20260810 18:38:11.965903 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.965398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51668)
0810 18:38:11.965652 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.965738 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260810 18:38:11.967115 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:11.966738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51670)
0810 18:38:11.966917 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:11.967014 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260810 18:38:11.967465 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
W20260810 18:38:12.032495 29050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:12.032771 29050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:12.032958 29050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:12.041563 29050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:12.041671 29050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:12.041776 29050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:12.041878 29050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:12.041968 29050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:12.047161 29040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 4
I20260810 18:38:12.048403 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.047825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51678)
0810 18:38:12.048085 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.048195 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 18:38:12.049463 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.049085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51686)
0810 18:38:12.049236 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.049323 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 18:38:12.049706 29040 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:12.052882 29050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:42269,127.13.139.61:41543,127.13.139.60:40547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab
--principal=kudu/127.13.139.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:40547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.139.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:12.054234 29050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:12.055619 29050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:12.067658 29057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:12.067587 29058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:12.068125 29060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:12.068578 29050 server_base.cc:1034] running on GCE node
I20260810 18:38:12.069380 29050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:12.070785 29050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:12.071983 29050 hybrid_clock.cc:648] HybridClock initialized: now 1786387092071942 us; error 27 us; skew 500 ppm
I20260810 18:38:12.072348 29050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:38:12.073737 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 3
I20260810 18:38:12.074987 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.074370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51692)
0810 18:38:12.074628 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.074735 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387092, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:12.076226 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.075774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51696)
0810 18:38:12.075987 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.076074 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260810 18:38:12.076445 28956 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:40547: Network error: Client connection negotiation failed: client connection to 127.13.139.60:40547: connect: Connection refused (error 111)
I20260810 18:38:12.076455 29050 init.cc:377] Logged in from keytab as kudu/127.13.139.60@KRBTEST.COM (short username kudu)
I20260810 18:38:12.078030 29050 webserver.cc:460] Webserver started at http://127.13.139.60:33739/ using document root <none> and password file <none>
I20260810 18:38:12.078691 29050 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:12.078790 29050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:12.079046 29050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:12.082185 29050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data/instance:
uuid: "29b39c097c874e03b6704c058afe774a"
format_stamp: "Formatted at 2026-08-10 18:38:12 on dist-test-slave-5k54"
server_key: "37b825318605ced9aadaf6f23374c826"
server_key_iv: "989bc9d6d95091dc00793e2bed31cdc0"
server_key_version: "encryptionkey@0"
I20260810 18:38:12.083000 29050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/wal/instance:
uuid: "29b39c097c874e03b6704c058afe774a"
format_stamp: "Formatted at 2026-08-10 18:38:12 on dist-test-slave-5k54"
server_key: "37b825318605ced9aadaf6f23374c826"
server_key_iv: "989bc9d6d95091dc00793e2bed31cdc0"
server_key_version: "encryptionkey@0"
I20260810 18:38:12.088455 29050 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 18:38:12.091929 29067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:12.093225 29050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:38:12.093394 29050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/wal
uuid: "29b39c097c874e03b6704c058afe774a"
format_stamp: "Formatted at 2026-08-10 18:38:12 on dist-test-slave-5k54"
server_key: "37b825318605ced9aadaf6f23374c826"
server_key_iv: "989bc9d6d95091dc00793e2bed31cdc0"
server_key_version: "encryptionkey@0"
I20260810 18:38:12.093602 29050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:12.106194 29050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:12.110678 29050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:12.110976 29050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:12.129914 29050 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.60:40547
I20260810 18:38:12.129948 29127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.60:40547 every 8 connection(s)
I20260810 18:38:12.131791 29050 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
I20260810 18:38:12.135536 29128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:12.141297 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 29050
I20260810 18:38:12.141499 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786386879896169-13868-0/minicluster-data/master-2/wal/instance
I20260810 18:38:12.142019 13868 external_mini_cluster.cc:1428] Setting key 1d920f1bac2fe4f380f0dcd8195ee20c
I20260810 18:38:12.142304 29128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387092, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:38:12.162750 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.145306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34216 (local address 127.13.139.62:42269)
0810 18:38:12.145534 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.145542 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.146402 (+ 860us) server_negotiation.cc:407] Connection header received
0810 18:38:12.147469 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.147478 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.147549 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.147631 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.149022 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.149768 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.151579 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.152255 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.152348 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.156213 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.156218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.156221 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.156252 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.159665 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.160400 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.160406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.160410 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.160587 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.160985 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.160990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.160993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.161293 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.161481 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.162164 (+ 683us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.162394 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 18:38:12.163843 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.145294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:42269 (local address 127.0.0.1:34216)
0810 18:38:12.146240 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.146291 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:12.147188 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:12.147724 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:12.147732 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:12.148471 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:12.148848 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.148864 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.149940 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.149946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.151358 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.151369 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.152483 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.152490 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.152844 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.153655 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:12.153676 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:12.156019 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:12.159790 (+ 3771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.159800 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.159809 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.160276 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.160701 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.160704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.160706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.160873 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.161425 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:12.161435 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:12.161768 (+ 333us) client_negotiation.cc:769] Sending connection context
0810 18:38:12.162068 (+ 300us) client_negotiation.cc:240] Negotiation successful
0810 18:38:12.162536 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":37,"thread_start_us":471,"threads_started":1}
I20260810 18:38:12.164013 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.143996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51710 (local address 127.13.139.60:40547)
0810 18:38:12.144822 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.144833 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.144870 (+ 37us) server_negotiation.cc:407] Connection header received
0810 18:38:12.147188 (+ 2318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.147215 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.147529 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.147740 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.149155 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.150596 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.152210 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.153041 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.153191 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.157558 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.157569 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.157585 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.157621 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.160981 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.161650 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.161665 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.161667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.161792 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.162192 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.162196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.162198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.162538 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.162843 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.163393 (+ 550us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.163665 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":596,"thread_start_us":352,"threads_started":1}
I20260810 18:38:12.165509 29128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387092, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:12.178961 29044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.166289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50492 (local address 127.13.139.61:41543)
0810 18:38:12.166508 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.166520 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.166699 (+ 179us) server_negotiation.cc:407] Connection header received
0810 18:38:12.166852 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.166857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.166936 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.167049 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.167902 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.168579 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.169736 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.170158 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.170292 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.173321 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.173327 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.173333 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.173371 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.176398 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.177118 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.177124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.177129 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.177284 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.177759 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.177763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.177765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.178007 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.178123 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.178561 (+ 438us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.178711 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:38:12.179109 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.166310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:41543 (local address 127.0.0.1:50492)
0810 18:38:12.166604 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.166626 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:12.166727 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:12.167120 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:12.167127 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:12.167608 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:12.167757 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.167765 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.168712 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.168720 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.169594 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.169606 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.170298 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.170303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.170512 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.171067 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:12.171087 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:12.173138 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:12.176583 (+ 3445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.176589 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.176594 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.177004 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.177410 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.177414 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.177416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.177640 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.178129 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:12.178136 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:12.178303 (+ 167us) client_negotiation.cc:769] Sending connection context
0810 18:38:12.178479 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 18:38:12.178734 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260810 18:38:12.180191 29128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:38:12.182164 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.167390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34228 (local address 127.13.139.62:42269)
0810 18:38:12.167580 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.167585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.167651 (+ 66us) server_negotiation.cc:407] Connection header received
0810 18:38:12.167831 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.167836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.167903 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.168011 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.169193 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.169914 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.171210 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.171707 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.171841 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.175823 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.175829 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.175833 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.175877 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.179315 (+ 3438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.180090 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.180096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.180101 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.180224 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.180634 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.180638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.180640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.181005 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.181297 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.181603 (+ 306us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.181818 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387092, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387090, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:38:12.193289 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.181046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51714)
0810 18:38:12.181325 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.181342 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:12.181433 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:12.181764 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:12.181770 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:12.182215 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:12.182400 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.182412 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.183391 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.183396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.184722 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.184733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.185425 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.185430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.185660 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.186177 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:12.186194 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:12.188110 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:12.190902 (+ 2792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.190910 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.190915 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.191258 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.191661 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.191668 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.191673 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.191807 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.192307 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:12.192311 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:12.192471 (+ 160us) client_negotiation.cc:769] Sending connection context
0810 18:38:12.192606 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 18:38:12.192891 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":4}
I20260810 18:38:12.193331 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.180967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51714 (local address 127.13.139.60:40547)
0810 18:38:12.181153 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.181158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.181418 (+ 260us) server_negotiation.cc:407] Connection header received
0810 18:38:12.181554 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.181559 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.181625 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.181723 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.182520 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.183265 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.184864 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.185291 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.185417 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.188293 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.188298 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.188301 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.188326 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.190777 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.191370 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.191378 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.191382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.191555 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.191907 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.191915 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.191918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.192179 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.192331 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.192686 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.193041 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":142,"server-negotiator.queue_time_us":48}
I20260810 18:38:12.197723 29044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.183950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.13.139.61:41543)
0810 18:38:12.184145 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.184152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.184171 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:38:12.184265 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.184270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.184333 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.184425 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.185630 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.186325 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.187583 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.188066 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.188197 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.192259 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.192264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.192267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.192300 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.195155 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.196000 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.196003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.196005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.196136 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.196508 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.196511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.196514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.196794 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.197049 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.197304 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.197465 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260810 18:38:12.199193 29128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: Bootstrap starting.
I20260810 18:38:12.202673 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:38:12.202834 29128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:12.204120 29128 log.cc:824] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:12.207371 29128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: No bootstrap required, opened a new log
I20260810 18:38:12.221302 29128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.221670 29128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:12.221873 29128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29b39c097c874e03b6704c058afe774a, State: Initialized, Role: FOLLOWER
I20260810 18:38:12.224598 29128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.234678 29144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.235338 29144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:38:12.236349 29128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:12.242901 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.208600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51720 (local address 127.13.139.60:40547)
0810 18:38:12.208763 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.208770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.223336 (+ 14566us) server_negotiation.cc:407] Connection header received
0810 18:38:12.223531 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.223538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.223620 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.223722 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.226197 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.227221 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.229624 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.230373 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.230476 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.234472 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.234479 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.234483 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.234532 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.238530 (+ 3998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.239649 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.239658 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.239664 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.239896 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.240457 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.240465 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.240471 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.241001 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.241309 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.242048 (+ 739us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.242356 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 18:38:12.244639 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.209209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34238 (local address 127.13.139.62:42269)
0810 18:38:12.209642 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.209651 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.222465 (+ 12814us) server_negotiation.cc:407] Connection header received
0810 18:38:12.222775 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.222784 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.222876 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.222956 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.225942 (+ 2986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.227395 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.230279 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.231199 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.231321 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.236905 (+ 5584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.236912 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.236931 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.236981 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.240727 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.241639 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.241644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.241647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.241812 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.242309 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.242313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.242316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.242692 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.243896 (+ 1204us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.244059 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.244288 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278}
I20260810 18:38:12.246321 29044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.208991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50500 (local address 127.13.139.61:41543)
0810 18:38:12.209427 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.209436 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.222645 (+ 13209us) server_negotiation.cc:407] Connection header received
0810 18:38:12.222746 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.222754 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.222866 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.222980 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.225864 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.227046 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.229339 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.230004 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.230127 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.237052 (+ 6925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.237058 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.237065 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.237112 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.242301 (+ 5189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.243522 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.243531 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.243538 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.243745 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.244293 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.244299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.244302 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.244752 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.245100 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.245735 (+ 635us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.245993 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288}
I20260810 18:38:12.253654 28956 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 4
W20260810 18:38:12.257091 29157 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:38:12.257287 29157 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:38:12.252053 29050 master_runner.cc:186] Error getting master registration for 127.13.139.62:42269: OK, instance_id { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" instance_seqno: 1786387091113587 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 18:38:12.263511 29050 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 18:38:12.269829 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.254257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51724)
0810 18:38:12.254440 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.254461 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:12.254566 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:12.256003 (+ 1437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:12.256010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:12.256535 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:12.256736 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.256748 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.258160 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.258166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.259376 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.259388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.260476 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.260482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.260670 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.261397 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:12.261421 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:12.263666 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:12.267259 (+ 3593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.267265 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.267269 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.267733 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.268114 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.268119 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.268122 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.268271 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.268812 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:12.268817 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:12.268988 (+ 171us) client_negotiation.cc:769] Sending connection context
0810 18:38:12.269126 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 18:38:12.269410 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 18:38:12.269831 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.255187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51724 (local address 127.13.139.60:40547)
0810 18:38:12.255523 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.255528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.255544 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:38:12.255597 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.255601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.255705 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.255815 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.256908 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.257984 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.259610 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.260311 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.260482 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.263852 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.263857 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.263861 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.263889 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.267128 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.267846 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.267854 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.267858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.267992 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.268387 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.268391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.268403 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.268692 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.268851 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.269232 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.269459 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260810 18:38:12.274184 28956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b: Bootstrap starting.
I20260810 18:38:12.277985 28956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:12.279013 28956 log.cc:824] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:12.281733 28956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b: No bootstrap required, opened a new log
I20260810 18:38:12.289532 28956 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.289825 28956 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:12.289999 28956 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3466c5ff465b47d882d607097886aa3b, State: Initialized, Role: FOLLOWER
I20260810 18:38:12.290550 28956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.291567 29161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.291982 29161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:38:12.292755 28956 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: configured and running, proceeding with master startup.
W20260810 18:38:12.307675 29173 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:38:12.307895 29173 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:38:12.302810 28879 master_runner.cc:186] Error getting master registration for 127.13.139.61:41543: OK, instance_id { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" instance_seqno: 1786387091615537 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 18:38:12.314966 28879 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 18:38:12.348943 29040 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } attempt: 5
W20260810 18:38:12.352622 28905 tablet.cc:2369] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 18:38:12 dist-test-slave-5k54 krb5kdc[28864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387091, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:38:12.359947 29161 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:38:12.360278 29161 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
W20260810 18:38:12.363576 29076 tablet.cc:2369] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:38:12.364749 29161 leader_election.cc:288] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7f14e07968040fd88099cb49eff6483 (127.13.139.61:41543), 29b39c097c874e03b6704c058afe774a (127.13.139.60:40547)
I20260810 18:38:12.366640 29100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3466c5ff465b47d882d607097886aa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29b39c097c874e03b6704c058afe774a" is_pre_election: true
I20260810 18:38:12.367256 29100 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3466c5ff465b47d882d607097886aa3b in term 0.
I20260810 18:38:12.368162 28902 leader_election.cc:302] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29b39c097c874e03b6704c058afe774a, 3466c5ff465b47d882d607097886aa3b; no voters:
I20260810 18:38:12.368716 29161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:38:12.368865 29161 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:38:12.368960 29161 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:12.369308 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.349576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:40547 (local address 127.0.0.1:51736)
0810 18:38:12.349949 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:12.349969 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:12.350081 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:12.350946 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:12.350952 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:12.351544 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:12.351775 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.351798 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.353387 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.353395 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.354830 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:12.354845 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.356065 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.356071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:12.356289 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.356988 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:12.357013 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:12.359830 (+ 2817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:12.366349 (+ 6519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.366355 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.366359 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.366913 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.367385 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:12.367390 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:12.367394 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:12.367598 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:12.368314 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:12.368320 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:12.368482 (+ 162us) client_negotiation.cc:769] Sending connection context
0810 18:38:12.368633 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 18:38:12.368915 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243}
I20260810 18:38:12.370330 29132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:12.350286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51736 (local address 127.13.139.60:40547)
0810 18:38:12.350476 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:12.350483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:12.350501 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:38:12.350555 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:12.350562 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:12.350640 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:12.350747 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:12.351998 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.353184 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.355012 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:12.355738 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:12.355862 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:12.360096 (+ 4234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:12.360103 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:12.360111 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:12.360156 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:12.366184 (+ 6028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.367066 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.367072 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.367077 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.367246 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:12.367734 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:12.367739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:12.367743 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:12.368095 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:12.368249 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:12.369710 (+ 1461us) server_negotiation.cc:299] Negotiation successful
0810 18:38:12.369959 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:38:12.374621 29161 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.375865 29161 leader_election.cc:288] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [CANDIDATE]: Term 1 election: Requested vote from peers c7f14e07968040fd88099cb49eff6483 (127.13.139.61:41543), 29b39c097c874e03b6704c058afe774a (127.13.139.60:40547)
I20260810 18:38:12.376780 29100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3466c5ff465b47d882d607097886aa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29b39c097c874e03b6704c058afe774a"
I20260810 18:38:12.377009 29100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:12.381764 29100 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3466c5ff465b47d882d607097886aa3b in term 1.
I20260810 18:38:12.382125 29040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483: Bootstrap starting.
I20260810 18:38:12.386309 29040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:12.386839 28902 leader_election.cc:302] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29b39c097c874e03b6704c058afe774a, 3466c5ff465b47d882d607097886aa3b; no voters:
I20260810 18:38:12.387164 29161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:12.388736 29040 log.cc:824] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:12.392479 29040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483: No bootstrap required, opened a new log
I20260810 18:38:12.399363 29161 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [term 1 LEADER]: Becoming Leader. State: Replica: 3466c5ff465b47d882d607097886aa3b, State: Running, Role: LEADER
I20260810 18:38:12.400018 29161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.412490 29040 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.412902 29040 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:12.413030 29040 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7f14e07968040fd88099cb49eff6483, State: Initialized, Role: FOLLOWER
I20260810 18:38:12.413690 29040 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } }
I20260810 18:38:12.419872 29179 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.420387 29179 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:38:12.421200 29040 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:12.421278 29013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3466c5ff465b47d882d607097886aa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7f14e07968040fd88099cb49eff6483"
I20260810 18:38:12.421753 29013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:12.422134 29014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3466c5ff465b47d882d607097886aa3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7f14e07968040fd88099cb49eff6483" is_pre_election: true
I20260810 18:38:12.426563 29013 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3466c5ff465b47d882d607097886aa3b in term 1.
I20260810 18:38:12.427470 29175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3466c5ff465b47d882d607097886aa3b. Latest consensus state: current_term: 1 leader_uuid: "3466c5ff465b47d882d607097886aa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.427989 29175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:12.440165 29181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:12.443015 29181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:12.460764 29100 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [term 1 FOLLOWER]: Refusing update from remote peer 3466c5ff465b47d882d607097886aa3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:12.461864 29175 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:12.470304 29013 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [term 1 FOLLOWER]: Refusing update from remote peer 3466c5ff465b47d882d607097886aa3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:12.471678 29175 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:12.484163 29179 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3466c5ff465b47d882d607097886aa3b. Latest consensus state: current_term: 1 leader_uuid: "3466c5ff465b47d882d607097886aa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.484517 29179 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:38:12.494890 29187 mvcc.cc:205] Tried to move back new op lower bound from 7317041530704134144 to 7317041530475114496. Current Snapshot: MvccSnapshot[applied={T|T < 7317041530704134144}]
I20260810 18:38:12.496083 29193 mvcc.cc:205] Tried to move back new op lower bound from 7317041530704134144 to 7317041530475114496. Current Snapshot: MvccSnapshot[applied={T|T < 7317041530704134144}]
I20260810 18:38:12.496698 29179 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3466c5ff465b47d882d607097886aa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.497900 29179 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:38:12.506695 29161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3466c5ff465b47d882d607097886aa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.507283 29161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:12.511982 29181 catalog_manager.cc:1347] Generated new cluster ID: 208d1f9b54994800949948ba52ab96e1
I20260810 18:38:12.512107 29181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:38:12.518376 29200 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 18:38:12.526577 29144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3466c5ff465b47d882d607097886aa3b. Latest consensus state: current_term: 1 leader_uuid: "3466c5ff465b47d882d607097886aa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.526894 29144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:38:12.529520 29175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3466c5ff465b47d882d607097886aa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.530218 29175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:12.538889 29144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3466c5ff465b47d882d607097886aa3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3466c5ff465b47d882d607097886aa3b" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 42269 } } peers { permanent_uuid: "c7f14e07968040fd88099cb49eff6483" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 41543 } } peers { permanent_uuid: "29b39c097c874e03b6704c058afe774a" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 40547 } } }
I20260810 18:38:12.539157 29144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:38:12.540470 29191 mvcc.cc:205] Tried to move back new op lower bound from 7317041530704134144 to 7317041530475114496. Current Snapshot: MvccSnapshot[applied={T|T < 7317041530704134144}]
I20260810 18:38:12.546042 29181 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:38:12.548017 29181 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:38:12.568361 29181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3466c5ff465b47d882d607097886aa3b: Generated new TSK 0
I20260810 18:38:12.569466 29181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:38:13.259269 29157 catalog_manager.cc:1259] Loaded cluster ID: 208d1f9b54994800949948ba52ab96e1
I20260810 18:38:13.259415 29157 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: loading cluster ID for follower catalog manager: success
I20260810 18:38:13.261801 29157 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: acquiring CA information for follower catalog manager: success
I20260810 18:38:13.263567 29157 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 29b39c097c874e03b6704c058afe774a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 18:38:13.523031 29200 catalog_manager.cc:1259] Loaded cluster ID: 208d1f9b54994800949948ba52ab96e1
I20260810 18:38:13.523138 29200 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483: loading cluster ID for follower catalog manager: success
I20260810 18:38:13.525758 29200 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483: acquiring CA information for follower catalog manager: success
I20260810 18:38:13.527667 29200 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c7f14e07968040fd88099cb49eff6483: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 18:38:13.657665 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 28879
I20260810 18:38:13.659240 28951 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:13.772733 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 28879
I20260810 18:38:13.806205 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 28966
I20260810 18:38:13.807602 29034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:13.922111 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 28966
I20260810 18:38:13.944793 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 29050
I20260810 18:38:13.945966 29122 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:14.074833 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 29050
2026-08-10T18:38:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4888 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:38:14 dist-test-slave-5k54 krb5kdc[29220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:38:14 dist-test-slave-5k54 krb5kdc[29220](info): set up 2 sockets
Aug 10 18:38:14 dist-test-slave-5k54 krb5kdc[29220](info): commencing operation
krb5kdc: starting...
W20260810 18:38:15.257483 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:38:15 dist-test-slave-5k54 krb5kdc[29220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:38:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:38:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:38:15.533075 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43151
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:43151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:15.868448 29236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:15.868777 29236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:15.868968 29236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:15.876806 29236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:15.876971 29236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:15.877064 29236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:15.877172 29236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:15.877255 29236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:15.887181 29236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:43151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:15.888540 29236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:15.889860 29236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:15.901768 29245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:15.901808 29242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:15.901710 29243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:15.902767 29236 server_base.cc:1034] running on GCE node
I20260810 18:38:15.903578 29236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:15.904946 29236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:15.906172 29236 hybrid_clock.cc:648] HybridClock initialized: now 1786387095906103 us; error 48 us; skew 500 ppm
I20260810 18:38:15.906543 29236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:15 dist-test-slave-5k54 krb5kdc[29220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387095, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:15.910158 29236 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:15.911592 29236 webserver.cc:460] Webserver started at http://127.13.139.62:37139/ using document root <none> and password file <none>
I20260810 18:38:15.912236 29236 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:15.912346 29236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:15.912599 29236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:15.915742 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "ea448879110147aa9504358a4b8fb111"
format_stamp: "Formatted at 2026-08-10 18:38:15 on dist-test-slave-5k54"
server_key: "620030c9ef70f2b56e7650cf4d0bfbbd"
server_key_iv: "0b13ece9a6bbad8217531e7664f148d6"
server_key_version: "encryptionkey@0"
I20260810 18:38:15.916462 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "ea448879110147aa9504358a4b8fb111"
format_stamp: "Formatted at 2026-08-10 18:38:15 on dist-test-slave-5k54"
server_key: "620030c9ef70f2b56e7650cf4d0bfbbd"
server_key_iv: "0b13ece9a6bbad8217531e7664f148d6"
server_key_version: "encryptionkey@0"
I20260810 18:38:15.921698 29236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260810 18:38:15.925483 29254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:15.926854 29236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:38:15.927083 29236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "ea448879110147aa9504358a4b8fb111"
format_stamp: "Formatted at 2026-08-10 18:38:15 on dist-test-slave-5k54"
server_key: "620030c9ef70f2b56e7650cf4d0bfbbd"
server_key_iv: "0b13ece9a6bbad8217531e7664f148d6"
server_key_version: "encryptionkey@0"
I20260810 18:38:15.927376 29236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:15.954169 29236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:15.958410 29236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:15.958714 29236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:15.977499 29236 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:43151
I20260810 18:38:15.977531 29313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:43151 every 8 connection(s)
I20260810 18:38:15.978874 29236 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:15.982609 29314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:15.988489 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 29236
I20260810 18:38:15.988734 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:38:15.989430 13868 external_mini_cluster.cc:1428] Setting key 482a1ae3c55ad89f445c7ae56721d197
I20260810 18:38:15.993456 29314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111: Bootstrap starting.
I20260810 18:38:15.997255 29314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:15.998399 29314 log.cc:824] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:16.001559 29314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111: No bootstrap required, opened a new log
Aug 10 18:38:16 dist-test-slave-5k54 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:16.012354 29314 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea448879110147aa9504358a4b8fb111" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43151 } }
I20260810 18:38:16.012825 29314 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:16.012945 29314 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea448879110147aa9504358a4b8fb111, State: Initialized, Role: FOLLOWER
I20260810 18:38:16.013615 29314 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea448879110147aa9504358a4b8fb111" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43151 } }
I20260810 18:38:16.013911 29314 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:38:16.014060 29314 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:38:16.014249 29314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:16.014393 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:15.991253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51406 (local address 127.13.139.62:43151)
0810 18:38:15.992124 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:15.992135 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:15.992175 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:38:15.993867 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:15.993888 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:15.994252 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:15.994554 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:15.996583 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:15.997946 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:15.999767 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:16.000413 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:16.000552 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:16.005493 (+ 4941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:16.005504 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:16.005527 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:16.005570 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:16.009757 (+ 4187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:16.010452 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:16.010460 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:16.010471 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:16.010706 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:16.011080 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:16.011085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:16.011088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:16.011822 (+ 734us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:16.012126 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:16.012501 (+ 375us) server_negotiation.cc:299] Negotiation successful
0810 18:38:16.012964 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":443,"threads_started":1}
I20260810 18:38:16.016784 29314 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea448879110147aa9504358a4b8fb111" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43151 } }
I20260810 18:38:16.017382 29314 leader_election.cc:302] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea448879110147aa9504358a4b8fb111; no voters:
I20260810 18:38:16.018030 29314 leader_election.cc:288] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:38:16.018175 29321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:16.018544 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:38:16.019649 29321 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [term 1 LEADER]: Becoming Leader. State: Replica: ea448879110147aa9504358a4b8fb111, State: Running, Role: LEADER
I20260810 18:38:16.020310 29314 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:16.020308 29321 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea448879110147aa9504358a4b8fb111" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43151 } }
I20260810 18:38:16.025789 29323 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea448879110147aa9504358a4b8fb111. Latest consensus state: current_term: 1 leader_uuid: "ea448879110147aa9504358a4b8fb111" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea448879110147aa9504358a4b8fb111" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43151 } } }
I20260810 18:38:16.026124 29323 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:16.026599 29322 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea448879110147aa9504358a4b8fb111" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea448879110147aa9504358a4b8fb111" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43151 } } }
I20260810 18:38:16.026909 29322 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111 [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:16.027870 29334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:16.032243 29334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:16.040726 29334 catalog_manager.cc:1347] Generated new cluster ID: bc9cee393606497a9a5cd3df97d61f8a
I20260810 18:38:16.040853 29334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:38:16.048235 29334 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:38:16.049434 29334 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:38:16.062237 29334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea448879110147aa9504358a4b8fb111: Generated new TSK 0
I20260810 18:38:16.063081 29334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:38:16.081033 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 29236
I20260810 18:38:16.082276 29308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:16.172979 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 29236
2026-08-10T18:38:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2095 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:38:16 dist-test-slave-5k54 krb5kdc[29346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:38:16 dist-test-slave-5k54 krb5kdc[29346](info): set up 2 sockets
Aug 10 18:38:16 dist-test-slave-5k54 krb5kdc[29346](info): commencing operation
krb5kdc: starting...
W20260810 18:38:17.381644 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:38:17 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:38:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:38:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:38:17.651703 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36849
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:17.996748 29360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:17.997081 29360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:17.997252 29360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:18.004442 29360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:18.004593 29360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:18.004702 29360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:18.004820 29360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:18.004917 29360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:18.014842 29360 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:36849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:18.016361 29360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:18.017726 29360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:18.029666 29366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:18.029690 29367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:18.029728 29370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:18.030750 29360 server_base.cc:1034] running on GCE node
I20260810 18:38:18.031577 29360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:18.032966 29360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:18.034210 29360 hybrid_clock.cc:648] HybridClock initialized: now 1786387098034164 us; error 48 us; skew 500 ppm
I20260810 18:38:18.034562 29360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:18 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387098, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:18.037798 29360 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:18.039389 29360 webserver.cc:460] Webserver started at http://127.13.139.62:35699/ using document root <none> and password file <none>
I20260810 18:38:18.040139 29360 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:18.040292 29360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:18.040613 29360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:18.043708 29360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "5618369cc46f48fbbb7bdf2f47d9b58c"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "4a27f261d8b0811c4b482f498c2208aa"
server_key_iv: "653b980e7b2af8c2bcc8111d5d1012d8"
server_key_version: "encryptionkey@0"
I20260810 18:38:18.044499 29360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "5618369cc46f48fbbb7bdf2f47d9b58c"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "4a27f261d8b0811c4b482f498c2208aa"
server_key_iv: "653b980e7b2af8c2bcc8111d5d1012d8"
server_key_version: "encryptionkey@0"
I20260810 18:38:18.049695 29360 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260810 18:38:18.053191 29377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:18.054564 29360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:38:18.054746 29360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "5618369cc46f48fbbb7bdf2f47d9b58c"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "4a27f261d8b0811c4b482f498c2208aa"
server_key_iv: "653b980e7b2af8c2bcc8111d5d1012d8"
server_key_version: "encryptionkey@0"
I20260810 18:38:18.054962 29360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:18.070286 29360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:18.074262 29360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:18.074553 29360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:18.093483 29360 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:36849
I20260810 18:38:18.093526 29434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:36849 every 8 connection(s)
I20260810 18:38:18.094866 29360 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:18.097554 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 29360
I20260810 18:38:18.097790 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:38:18.098662 13868 external_mini_cluster.cc:1428] Setting key 600dd84bf29aab3661620563a6082280
I20260810 18:38:18.099176 29435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:18.114208 29435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Bootstrap starting.
Aug 10 18:38:18 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:18.118126 29435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:18.119541 29435 log.cc:824] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:18.122823 29435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: No bootstrap required, opened a new log
I20260810 18:38:18.124295 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:18.100866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51068 (local address 127.13.139.62:36849)
0810 18:38:18.101672 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:18.101684 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:18.101724 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:38:18.104067 (+ 2343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:18.104088 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:18.104490 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:18.104843 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:18.106585 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:18.107986 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:18.109849 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:18.110568 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:18.110705 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:18.115903 (+ 5198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:18.115915 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:18.115949 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:18.116008 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:18.119995 (+ 3987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:18.120897 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:18.120903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:18.120909 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:18.121130 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:18.121526 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:18.121535 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:18.121538 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:18.122073 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:18.122395 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:18.122840 (+ 445us) server_negotiation.cc:299] Negotiation successful
0810 18:38:18.123271 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":381,"threads_started":1}
I20260810 18:38:18.131019 29435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:18.131394 29435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:18.131543 29435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5618369cc46f48fbbb7bdf2f47d9b58c, State: Initialized, Role: FOLLOWER
I20260810 18:38:18.132181 29435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:18.132429 29435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:38:18.132584 29435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:38:18.132762 29435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:18.135046 29435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:18.135612 29435 leader_election.cc:302] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5618369cc46f48fbbb7bdf2f47d9b58c; no voters:
I20260810 18:38:18.136168 29435 leader_election.cc:288] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:38:18.136276 29440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:18.137015 29440 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 LEADER]: Becoming Leader. State: Replica: 5618369cc46f48fbbb7bdf2f47d9b58c, State: Running, Role: LEADER
I20260810 18:38:18.137578 29440 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:18.138228 29435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:18.140654 29442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5618369cc46f48fbbb7bdf2f47d9b58c. Latest consensus state: current_term: 1 leader_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } } }
I20260810 18:38:18.140668 29441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } } }
I20260810 18:38:18.141134 29441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:18.142001 29446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:18.141769 29442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:18.148257 29446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:18.157858 29446 catalog_manager.cc:1347] Generated new cluster ID: df45abdf7e0a41edbb0975390373466a
I20260810 18:38:18.157982 29446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:38:18.172551 29446 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:38:18.174039 29446 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:38:18.180373 29446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Generated new TSK 0
I20260810 18:38:18.181128 29446 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:38:18.257341 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:36849
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:18.629757 29466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:18.630050 29466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:18.630153 29466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:18.638134 29466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:18.638270 29466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:18.638497 29466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:38:18.648346 29466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:18.649643 29466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:18.650966 29466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:18.664062 29471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:18.664170 29474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:18.664194 29472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:18.665167 29466 server_base.cc:1034] running on GCE node
I20260810 18:38:18.665750 29466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:18.666659 29466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:18.667881 29466 hybrid_clock.cc:648] HybridClock initialized: now 1786387098667837 us; error 33 us; skew 500 ppm
I20260810 18:38:18.668187 29466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:18 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387098, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:18.671388 29466 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:38:18.672736 29466 webserver.cc:460] Webserver started at http://127.13.139.1:44633/ using document root <none> and password file <none>
I20260810 18:38:18.673377 29466 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:18.673480 29466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:18.673722 29466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:18.676550 29466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "9d42319121254539afe309f0e08cd964"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "1422852d47648968a45e885640272357"
server_key_iv: "5149929ad7d8a7d032059e4c665d20a5"
server_key_version: "encryptionkey@0"
I20260810 18:38:18.677299 29466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "9d42319121254539afe309f0e08cd964"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "1422852d47648968a45e885640272357"
server_key_iv: "5149929ad7d8a7d032059e4c665d20a5"
server_key_version: "encryptionkey@0"
I20260810 18:38:18.682391 29466 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:38:18.685664 29483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:18.686887 29466 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 18:38:18.687054 29466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "9d42319121254539afe309f0e08cd964"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "1422852d47648968a45e885640272357"
server_key_iv: "5149929ad7d8a7d032059e4c665d20a5"
server_key_version: "encryptionkey@0"
I20260810 18:38:18.687247 29466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:18.708771 29466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:18.713131 29466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:18.713471 29466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:18.714768 29466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:18.716205 29466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:18.716326 29466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:18.716475 29466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:18.716549 29466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:18.750460 29466 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:34659
I20260810 18:38:18.750502 29612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:34659 every 8 connection(s)
I20260810 18:38:18.751847 29466 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:38:18.760164 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 29466
I20260810 18:38:18.760416 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:38:18.761286 13868 external_mini_cluster.cc:1428] Setting key 3e08af076d4ea3428e74a27c6a0d097d
Aug 10 18:38:18 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387098, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:18.773511 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:18.754366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:35783 (local address 127.13.139.62:36849)
0810 18:38:18.754879 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:18.754883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:18.755753 (+ 870us) server_negotiation.cc:407] Connection header received
0810 18:38:18.757586 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:18.757591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:18.757692 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:18.757818 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:18.759486 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:18.760408 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:18.762675 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:18.763364 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:18.763538 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:18.767779 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:18.767784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:18.767787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:18.767819 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:18.770407 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:18.771149 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:18.771157 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:18.771160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:18.771297 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:18.771754 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:18.771760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:18.771764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:18.772027 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:18.772200 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:18.772907 (+ 707us) server_negotiation.cc:299] Negotiation successful
0810 18:38:18.773129 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":280,"threads_started":1}
I20260810 18:38:18.774482 29617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:18.754781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:35783)
0810 18:38:18.755588 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:18.755635 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:18.757300 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:18.758068 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:18.758075 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:18.758595 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:18.759272 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:18.759291 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:18.760618 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:18.760625 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:18.762531 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:18.762543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:18.763648 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:18.763656 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:18.763952 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:18.764728 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:18.764760 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:18.767568 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:18.770562 (+ 2994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:18.770570 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:18.770586 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:18.771024 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:18.771412 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:18.771417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:18.771447 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:18.771637 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:18.772158 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:18.772167 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:18.772510 (+ 343us) client_negotiation.cc:769] Sending connection context
0810 18:38:18.772784 (+ 274us) client_negotiation.cc:240] Negotiation successful
0810 18:38:18.773318 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":281,"threads_started":1}
I20260810 18:38:18.776152 29613 heartbeater.cc:347] Connected to a master server at 127.13.139.62:36849
I20260810 18:38:18.776472 29613 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:18.777190 29613 heartbeater.cc:511] Master 127.13.139.62:36849 requested a full tablet report, sending...
I20260810 18:38:18.779301 29397 ts_manager.cc:194] Registered new tserver with Master: 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659)
I20260810 18:38:18.780779 29397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:35783
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:38:18.824232 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:36849
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:19.415773 29620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:19.416065 29620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:19.416249 29620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:19.427719 29620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:19.427861 29620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:19.428052 29620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:38:19.443730 29620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:19.445415 29620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:19.446764 29620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:19.467000 29626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:19.467677 29628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:19.467756 29625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:19.468986 29620 server_base.cc:1034] running on GCE node
I20260810 18:38:19.470039 29620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:19.471662 29620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:19.472975 29620 hybrid_clock.cc:648] HybridClock initialized: now 1786387099472880 us; error 96 us; skew 500 ppm
I20260810 18:38:19.473508 29620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:19 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387099, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:19.478693 29620 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:38:19.480350 29620 webserver.cc:460] Webserver started at http://127.13.139.2:43777/ using document root <none> and password file <none>
I20260810 18:38:19.481076 29620 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:19.481230 29620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:19.481549 29620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:19.487003 29620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "dbdf70a038004d9db38d81fdf4fdfbdd"
format_stamp: "Formatted at 2026-08-10 18:38:19 on dist-test-slave-5k54"
server_key: "cbf05ce038b6c6a4508165986078fd0d"
server_key_iv: "d7a139f6435e226dc953a5b4271411e1"
server_key_version: "encryptionkey@0"
I20260810 18:38:19.488567 29620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "dbdf70a038004d9db38d81fdf4fdfbdd"
format_stamp: "Formatted at 2026-08-10 18:38:19 on dist-test-slave-5k54"
server_key: "cbf05ce038b6c6a4508165986078fd0d"
server_key_iv: "d7a139f6435e226dc953a5b4271411e1"
server_key_version: "encryptionkey@0"
I20260810 18:38:19.497651 29620 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260810 18:38:19.503997 29636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:19.506028 29620 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260810 18:38:19.506313 29620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "dbdf70a038004d9db38d81fdf4fdfbdd"
format_stamp: "Formatted at 2026-08-10 18:38:19 on dist-test-slave-5k54"
server_key: "cbf05ce038b6c6a4508165986078fd0d"
server_key_iv: "d7a139f6435e226dc953a5b4271411e1"
server_key_version: "encryptionkey@0"
I20260810 18:38:19.506667 29620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:19.536441 29620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:19.542138 29620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:19.542543 29620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:19.544075 29620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:19.546316 29620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:19.546430 29620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:19.546572 29620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:19.546648 29620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:19.598063 29620 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:35089
I20260810 18:38:19.598124 29765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:35089 every 8 connection(s)
I20260810 18:38:19.600276 29620 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:38:19.602932 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 29620
I20260810 18:38:19.603274 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:38:19.604322 13868 external_mini_cluster.cc:1428] Setting key e1da76ca129cec8e7aab4fb24a52d727
Aug 10 18:38:19 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387099, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:19.643721 29770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:19.605659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:58933 (local address 127.13.139.62:36849)
0810 18:38:19.607306 (+ 1647us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:19.607314 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:19.614732 (+ 7418us) server_negotiation.cc:407] Connection header received
0810 18:38:19.618301 (+ 3569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:19.618310 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:19.618437 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:19.618565 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:19.620236 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:19.621536 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:19.624509 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:19.625558 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:19.625713 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:19.635323 (+ 9610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:19.635328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:19.635332 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:19.635368 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:19.638208 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:19.639273 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:19.639291 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:19.639295 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:19.639582 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:19.640352 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:19.640366 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:19.640370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:19.641006 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:19.641267 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:19.642474 (+ 1207us) server_negotiation.cc:299] Negotiation successful
0810 18:38:19.642945 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1499,"thread_start_us":1356,"threads_started":1}
I20260810 18:38:19.645457 29771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:19.606309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:58933)
0810 18:38:19.614284 (+ 7975us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:19.614391 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:19.618000 (+ 3609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:19.618822 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:19.618831 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:19.619378 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:19.620053 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:19.620071 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:19.621794 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:19.621799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:19.624289 (+ 2490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:19.624310 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:19.626032 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:19.626054 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:19.626764 (+ 710us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:19.632067 (+ 5303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:19.632132 (+ 65us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:19.635052 (+ 2920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:19.638396 (+ 3344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:19.638406 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:19.638425 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:19.639064 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:19.639788 (+ 724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:19.639805 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:19.639813 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:19.640145 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:19.641231 (+ 1086us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:19.641251 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:19.641839 (+ 588us) client_negotiation.cc:769] Sending connection context
0810 18:38:19.642309 (+ 470us) client_negotiation.cc:240] Negotiation successful
0810 18:38:19.643401 (+ 1092us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7350,"spinlock_wait_cycles":92928,"thread_start_us":7202,"threads_started":1}
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
I20260810 18:38:19.648270 29767 heartbeater.cc:347] Connected to a master server at 127.13.139.62:36849
I20260810 18:38:19.648801 29767 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:19.650257 29767 heartbeater.cc:511] Master 127.13.139.62:36849 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
I20260810 18:38:19.652236 29397 ts_manager.cc:194] Registered new tserver with Master: dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089)
I20260810 18:38:19.653088 29397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:58933
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:38:19.697702 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:36849
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:38:19.783749 29613 heartbeater.cc:503] Master 127.13.139.62:36849 was elected leader, sending a full tablet report...
W20260810 18:38:20.227415 29775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:20.227969 29775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:20.228245 29775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:20.239667 29775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:20.239807 29775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:20.240005 29775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:38:20.253798 29775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:20.255980 29775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:20.258208 29775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:20.277583 29784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:20.277624 29782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:20.277906 29781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:20.278761 29775 server_base.cc:1034] running on GCE node
I20260810 18:38:20.279930 29775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:20.281602 29775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:20.282900 29775 hybrid_clock.cc:648] HybridClock initialized: now 1786387100282828 us; error 72 us; skew 500 ppm
I20260810 18:38:20.283550 29775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:20 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387100, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:20.288461 29775 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:38:20.290699 29775 webserver.cc:460] Webserver started at http://127.13.139.3:42443/ using document root <none> and password file <none>
I20260810 18:38:20.292080 29775 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:20.292317 29775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:20.292853 29775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:20.297230 29775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5"
format_stamp: "Formatted at 2026-08-10 18:38:20 on dist-test-slave-5k54"
server_key: "9865b99242f4c200efab1382b24f04cc"
server_key_iv: "532f041f18d4a7166d60cf85e09d1b7c"
server_key_version: "encryptionkey@0"
I20260810 18:38:20.298620 29775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5"
format_stamp: "Formatted at 2026-08-10 18:38:20 on dist-test-slave-5k54"
server_key: "9865b99242f4c200efab1382b24f04cc"
server_key_iv: "532f041f18d4a7166d60cf85e09d1b7c"
server_key_version: "encryptionkey@0"
I20260810 18:38:20.307327 29775 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.010s sys 0.001s
I20260810 18:38:20.310988 29791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:20.313302 29775 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260810 18:38:20.313555 29775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5"
format_stamp: "Formatted at 2026-08-10 18:38:20 on dist-test-slave-5k54"
server_key: "9865b99242f4c200efab1382b24f04cc"
server_key_iv: "532f041f18d4a7166d60cf85e09d1b7c"
server_key_version: "encryptionkey@0"
I20260810 18:38:20.313887 29775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:20.352192 29775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:20.359661 29775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:20.360239 29775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:20.361824 29775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:20.364019 29775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:20.364185 29775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:20.364423 29775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:20.364543 29775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:20.421919 29775 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:39077
I20260810 18:38:20.421975 29916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:39077 every 8 connection(s)
I20260810 18:38:20.424132 29775 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:38:20.431313 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 29775
I20260810 18:38:20.431666 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:38:20.432407 13868 external_mini_cluster.cc:1428] Setting key b24f93b868dee82ac58139a898652ee6
Aug 10 18:38:20 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387100, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:20.459671 29920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.428259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:51471 (local address 127.13.139.62:36849)
0810 18:38:20.429013 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.429017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.430626 (+ 1609us) server_negotiation.cc:407] Connection header received
0810 18:38:20.434212 (+ 3586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.434218 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.434362 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.434584 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:20.438280 (+ 3696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.439751 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.442527 (+ 2776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.443224 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.443402 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.449568 (+ 6166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:20.449577 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:20.449581 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:20.449649 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:20.454649 (+ 5000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:20.456166 (+ 1517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:20.456171 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:20.456173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:20.456441 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:20.457074 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:20.457080 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:20.457082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:20.457622 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:20.457847 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.458790 (+ 943us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.459156 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":393,"threads_started":1}
I20260810 18:38:20.461490 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.429091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:51471)
0810 18:38:20.430377 (+ 1286us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:20.430447 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:20.433738 (+ 3291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:20.435172 (+ 1434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:20.435202 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:20.436633 (+ 1431us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:20.438008 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.438037 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.440012 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.440018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.442294 (+ 2276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.442324 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.443577 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.443613 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.444005 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.445104 (+ 1099us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:20.445144 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:20.449083 (+ 3939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:20.454905 (+ 5822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:20.454998 (+ 93us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:20.455034 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:20.455956 (+ 922us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:20.456597 (+ 641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:20.456601 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:20.456603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:20.456912 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:20.457801 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:20.457808 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:20.458356 (+ 548us) client_negotiation.cc:769] Sending connection context
0810 18:38:20.458616 (+ 260us) client_negotiation.cc:240] Negotiation successful
0810 18:38:20.459379 (+ 763us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"thread_start_us":534,"threads_started":1}
I20260810 18:38:20.464012 29918 heartbeater.cc:347] Connected to a master server at 127.13.139.62:36849
I20260810 18:38:20.464460 29918 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:20.465968 29918 heartbeater.cc:511] Master 127.13.139.62:36849 requested a full tablet report, sending...
I20260810 18:38:20.468209 29397 ts_manager.cc:194] Registered new tserver with Master: f5edc9a2cd9d4d02b6237de2f1ab94d5 (127.13.139.3:39077)
I20260810 18:38:20.469502 29397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:51471
I20260810 18:38:20.479182 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:38:20.508107 29920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.486677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51076 (local address 127.13.139.62:36849)
0810 18:38:20.487063 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.487085 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.487742 (+ 657us) server_negotiation.cc:407] Connection header received
0810 18:38:20.487979 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.487984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.488076 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.488200 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:20.490530 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.491917 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.494132 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.494802 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.495114 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.498971 (+ 3857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:20.498991 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:20.499003 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:20.499056 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:20.503292 (+ 4236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:20.504413 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:20.504434 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:20.504438 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:20.504649 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:20.505334 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:20.505355 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:20.505372 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:20.505908 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:20.506387 (+ 479us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.507025 (+ 638us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.507514 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260810 18:38:20.514434 29397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:38:20.526320 29397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:38:20.574365 29935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.548330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41780 (local address 127.13.139.3:39077)
0810 18:38:20.557981 (+ 9651us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.558011 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.559467 (+ 1456us) server_negotiation.cc:407] Connection header received
0810 18:38:20.559950 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.559975 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.560462 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.560811 (+ 349us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:20.562508 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.565122 (+ 2614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.569436 (+ 4314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.572121 (+ 2685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.572387 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.572865 (+ 478us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.573311 (+ 446us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.573671 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9237,"thread_start_us":8843,"threads_started":1}
I20260810 18:38:20.574960 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.547513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57532 (local address 127.13.139.1:34659)
0810 18:38:20.558364 (+ 10851us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.558389 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.558437 (+ 48us) server_negotiation.cc:407] Connection header received
0810 18:38:20.558620 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.558638 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.559117 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.559610 (+ 493us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:20.561097 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.563758 (+ 2661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.570071 (+ 6313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.572403 (+ 2332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.572682 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.573064 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.574061 (+ 997us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.574337 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10518,"thread_start_us":10506,"threads_started":1}
I20260810 18:38:20.576387 29933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.546918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57532)
0810 18:38:20.557571 (+ 10653us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:20.557678 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:20.558010 (+ 332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:20.559671 (+ 1661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:20.559704 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:20.559784 (+ 80us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:20.560711 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.560741 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.564040 (+ 3299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.564057 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.569759 (+ 5702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.569782 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.573308 (+ 3526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.573316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.573691 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.573759 (+ 68us) client_negotiation.cc:769] Sending connection context
0810 18:38:20.575541 (+ 1782us) client_negotiation.cc:240] Negotiation successful
0810 18:38:20.575780 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10161,"mutex_wait_us":1346,"thread_start_us":11742,"threads_started":1}
I20260810 18:38:20.576483 29932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.547205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:39077 (local address 127.0.0.1:41780)
0810 18:38:20.559222 (+ 12017us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:20.559287 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:20.559539 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:20.561332 (+ 1793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:20.561339 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:20.561392 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:20.562160 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.562176 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.565400 (+ 3224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.565418 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.569131 (+ 3713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.569167 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.572451 (+ 3284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.572461 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.572853 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.572974 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 18:38:20.573230 (+ 256us) client_negotiation.cc:240] Negotiation successful
0810 18:38:20.575385 (+ 2155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11709,"mutex_wait_us":2,"thread_start_us":11142,"threads_started":1}
I20260810 18:38:20.583102 29848 tablet_service.cc:1467] Processing CreateTablet for tablet 955c833ba4e943b687c811718aca1d3c (DEFAULT_TABLE table=test-table [id=0bff9d200d784514b899f5fcbe5961fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:20.583118 29538 tablet_service.cc:1467] Processing CreateTablet for tablet 955c833ba4e943b687c811718aca1d3c (DEFAULT_TABLE table=test-table [id=0bff9d200d784514b899f5fcbe5961fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:20.585706 29848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955c833ba4e943b687c811718aca1d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:20.585714 29538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955c833ba4e943b687c811718aca1d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:20.586076 29938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.560618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:35089 (local address 127.0.0.1:59092)
0810 18:38:20.569521 (+ 8903us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:20.569552 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:20.569754 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:20.571023 (+ 1269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:20.571029 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:20.571083 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:20.571816 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.571840 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.575627 (+ 3787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.575634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.580668 (+ 5034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.580697 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.583943 (+ 3246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.583961 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.584276 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.584349 (+ 73us) client_negotiation.cc:769] Sending connection context
0810 18:38:20.585144 (+ 795us) client_negotiation.cc:240] Negotiation successful
0810 18:38:20.585390 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8663,"thread_start_us":8337,"threads_started":1}
I20260810 18:38:20.587345 29936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.560196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59092 (local address 127.13.139.2:35089)
0810 18:38:20.568714 (+ 8518us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.568737 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.569999 (+ 1262us) server_negotiation.cc:407] Connection header received
0810 18:38:20.570212 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.570237 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.570657 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.571028 (+ 371us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:20.572110 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.574928 (+ 2818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.580961 (+ 6033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.583620 (+ 2659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.583868 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.584710 (+ 842us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.586471 (+ 1761us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.586780 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8295,"thread_start_us":8178,"threads_started":1}
I20260810 18:38:20.594100 29690 tablet_service.cc:1467] Processing CreateTablet for tablet 955c833ba4e943b687c811718aca1d3c (DEFAULT_TABLE table=test-table [id=0bff9d200d784514b899f5fcbe5961fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:20.598363 29690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955c833ba4e943b687c811718aca1d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:20.608677 29939 tablet_bootstrap.cc:492] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Bootstrap starting.
I20260810 18:38:20.612494 29940 tablet_bootstrap.cc:492] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Bootstrap starting.
I20260810 18:38:20.615913 29939 tablet_bootstrap.cc:654] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:20.618286 29939 log.cc:824] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:20.619606 29940 tablet_bootstrap.cc:654] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:20.622529 29940 log.cc:824] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:20.629721 29943 tablet_bootstrap.cc:492] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Bootstrap starting.
I20260810 18:38:20.631078 29939 tablet_bootstrap.cc:492] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: No bootstrap required, opened a new log
I20260810 18:38:20.631587 29939 ts_tablet_manager.cc:1397] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.013s
I20260810 18:38:20.631965 29940 tablet_bootstrap.cc:492] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: No bootstrap required, opened a new log
I20260810 18:38:20.632450 29940 ts_tablet_manager.cc:1397] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.000s
I20260810 18:38:20.634791 29943 tablet_bootstrap.cc:654] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:20.636610 29943 log.cc:824] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:20.641973 29943 tablet_bootstrap.cc:492] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: No bootstrap required, opened a new log
I20260810 18:38:20.642428 29943 ts_tablet_manager.cc:1397] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260810 18:38:20.652230 29939 raft_consensus.cc:348] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.653148 29939 raft_consensus.cc:374] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:20.653362 29939 raft_consensus.cc:729] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d42319121254539afe309f0e08cd964, State: Initialized, Role: FOLLOWER
I20260810 18:38:20.652801 29940 raft_consensus.cc:348] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.653637 29940 raft_consensus.cc:374] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:20.653815 29940 raft_consensus.cc:729] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5edc9a2cd9d4d02b6237de2f1ab94d5, State: Initialized, Role: FOLLOWER
I20260810 18:38:20.654539 29939 consensus_queue.cc:260] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.655133 29940 consensus_queue.cc:260] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.656757 29767 heartbeater.cc:503] Master 127.13.139.62:36849 was elected leader, sending a full tablet report...
I20260810 18:38:20.658447 29939 ts_tablet_manager.cc:1428] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Time spent starting tablet: real 0.027s user 0.022s sys 0.002s
I20260810 18:38:20.663632 29918 heartbeater.cc:503] Master 127.13.139.62:36849 was elected leader, sending a full tablet report...
I20260810 18:38:20.662943 29943 raft_consensus.cc:348] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.663894 29943 raft_consensus.cc:374] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:20.664050 29943 raft_consensus.cc:729] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbdf70a038004d9db38d81fdf4fdfbdd, State: Initialized, Role: FOLLOWER
I20260810 18:38:20.665302 29940 ts_tablet_manager.cc:1428] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Time spent starting tablet: real 0.033s user 0.023s sys 0.008s
I20260810 18:38:20.665357 29943 consensus_queue.cc:260] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.668973 29943 ts_tablet_manager.cc:1428] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Time spent starting tablet: real 0.026s user 0.025s sys 0.000s
I20260810 18:38:20.675995 29946 raft_consensus.cc:482] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 18:38:20.676800 29919 tablet.cc:2369] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:38:20.676448 29946 raft_consensus.cc:504] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.679796 29946 leader_election.cc:288] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659), dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089)
I20260810 18:38:20.690719 29936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.680726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:41285 (local address 127.13.139.2:35089)
0810 18:38:20.681818 (+ 1092us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.681832 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.681873 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:38:20.682060 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.682071 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.682184 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.682419 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:20.683721 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.685028 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.687866 (+ 2838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.689144 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.689443 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.689594 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.690042 (+ 448us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.690242 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":765}
I20260810 18:38:20.690726 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.680686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:35089 (local address 127.13.139.3:41285)
0810 18:38:20.680986 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:20.681019 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:20.681234 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:20.682452 (+ 1218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:20.682458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:20.682516 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:20.682979 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.682989 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.685335 (+ 2346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.685353 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.687628 (+ 2275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.687652 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.689440 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.689448 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.689772 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.689826 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 18:38:20.689999 (+ 173us) client_negotiation.cc:240] Negotiation successful
0810 18:38:20.690225 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260810 18:38:20.691532 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.681068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:45891 (local address 127.13.139.1:34659)
0810 18:38:20.681839 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.681867 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.682877 (+ 1010us) server_negotiation.cc:407] Connection header received
0810 18:38:20.683190 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.683203 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.683318 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.683521 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:20.684486 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.685860 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.688641 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.689869 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.690161 (+ 292us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.690263 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.690766 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.690988 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511}
I20260810 18:38:20.691738 29948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.680727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.13.139.3:45891)
0810 18:38:20.682693 (+ 1966us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:20.682734 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:20.682990 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:20.683607 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:20.683611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:20.683644 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:20.684248 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.684268 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.686144 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.686152 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.688415 (+ 2263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:20.688430 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.690205 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.690212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:20.690443 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.690486 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 18:38:20.690734 (+ 248us) client_negotiation.cc:240] Negotiation successful
0810 18:38:20.690956 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1744,"mutex_wait_us":261,"thread_start_us":1080,"threads_started":1}
I20260810 18:38:20.692813 29712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955c833ba4e943b687c811718aca1d3c" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" is_pre_election: true
I20260810 18:38:20.693387 29562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955c833ba4e943b687c811718aca1d3c" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d42319121254539afe309f0e08cd964" is_pre_election: true
I20260810 18:38:20.693709 29712 raft_consensus.cc:2454] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 0.
I20260810 18:38:20.694183 29562 raft_consensus.cc:2454] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 0.
I20260810 18:38:20.694757 29797 leader_election.cc:302] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dbdf70a038004d9db38d81fdf4fdfbdd, f5edc9a2cd9d4d02b6237de2f1ab94d5; no voters:
I20260810 18:38:20.695469 29946 raft_consensus.cc:2781] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:38:20.695721 29946 raft_consensus.cc:482] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:38:20.695955 29946 raft_consensus.cc:3037] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:20.700503 29946 raft_consensus.cc:504] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.701676 29946 leader_election.cc:288] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659), dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089)
I20260810 18:38:20.702453 29562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955c833ba4e943b687c811718aca1d3c" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d42319121254539afe309f0e08cd964"
I20260810 18:38:20.702666 29712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955c833ba4e943b687c811718aca1d3c" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd"
I20260810 18:38:20.702797 29562 raft_consensus.cc:3037] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:20.703003 29712 raft_consensus.cc:3037] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:20.707494 29562 raft_consensus.cc:2454] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 1.
I20260810 18:38:20.707620 29712 raft_consensus.cc:2454] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 1.
I20260810 18:38:20.708557 29792 leader_election.cc:302] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d42319121254539afe309f0e08cd964, f5edc9a2cd9d4d02b6237de2f1ab94d5; no voters:
I20260810 18:38:20.709210 29946 raft_consensus.cc:2781] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:20.710011 29946 raft_consensus.cc:686] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 LEADER]: Becoming Leader. State: Replica: f5edc9a2cd9d4d02b6237de2f1ab94d5, State: Running, Role: LEADER
I20260810 18:38:20.710810 29946 consensus_queue.cc:237] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } }
I20260810 18:38:20.719198 29396 catalog_manager.cc:5495] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5edc9a2cd9d4d02b6237de2f1ab94d5 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } health_report { overall_health: UNKNOWN } } }
I20260810 18:38:20.745680 29935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.740074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.13.139.3:39077)
0810 18:38:20.740294 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.740301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.740420 (+ 119us) server_negotiation.cc:407] Connection header received
0810 18:38:20.740692 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.740697 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.740776 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.740957 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:38:20.741328 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.742066 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.743547 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.743960 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.744096 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.744599 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:38:20.745110 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:38:20.745273 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.745330 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.745415 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:38:20.754705 29562 raft_consensus.cc:1261] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Refusing update from remote peer f5edc9a2cd9d4d02b6237de2f1ab94d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:20.754968 29712 raft_consensus.cc:1261] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Refusing update from remote peer f5edc9a2cd9d4d02b6237de2f1ab94d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 18:38:20.755296 29614 tablet.cc:2369] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:38:20.755852 29946 consensus_queue.cc:1035] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:20.756189 29949 consensus_queue.cc:1035] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:20.769558 29953 mvcc.cc:205] Tried to move back new op lower bound from 7317041564680093696 to 7317041564519071744. Current Snapshot: MvccSnapshot[applied={T|T < 7317041564680093696}]
I20260810 18:38:20.790063 29395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:20.790381 29395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:20.794164 29395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Sending DeleteTablet for 3 replicas of tablet 955c833ba4e943b687c811718aca1d3c
I20260810 18:38:20.795384 29538 tablet_service.cc:1514] Processing DeleteTablet for tablet 955c833ba4e943b687c811718aca1d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:20 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:57532
I20260810 18:38:20.795552 29690 tablet_service.cc:1514] Processing DeleteTablet for tablet 955c833ba4e943b687c811718aca1d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:20 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:59092
I20260810 18:38:20.795697 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 29466
I20260810 18:38:20.796474 29848 tablet_service.cc:1514] Processing DeleteTablet for tablet 955c833ba4e943b687c811718aca1d3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:20 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:41780
I20260810 18:38:20.808391 29966 tablet_replica.cc:330] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: stopping tablet replica
I20260810 18:38:20.809805 29964 tablet_replica.cc:330] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: stopping tablet replica
I20260810 18:38:20.810034 29963 tablet_replica.cc:330] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: stopping tablet replica
I20260810 18:38:20.809828 29966 raft_consensus.cc:2229] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:38:20.810487 29963 raft_consensus.cc:2229] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:20.810916 29966 raft_consensus.cc:2258] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:20.811085 29963 raft_consensus.cc:2258] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:20.812103 29964 raft_consensus.cc:2229] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:20.812593 29964 raft_consensus.cc:2258] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:20.814213 29963 ts_tablet_manager.cc:1905] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:20.814218 29966 ts_tablet_manager.cc:1905] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:20.815570 29964 ts_tablet_manager.cc:1905] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:20.821715 29963 ts_tablet_manager.cc:1918] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:20.821816 29966 ts_tablet_manager.cc:1918] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:20.822001 29966 log.cc:1196] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/955c833ba4e943b687c811718aca1d3c
I20260810 18:38:20.822022 29963 log.cc:1196] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/955c833ba4e943b687c811718aca1d3c
I20260810 18:38:20.822611 29966 ts_tablet_manager.cc:1939] T 955c833ba4e943b687c811718aca1d3c P f5edc9a2cd9d4d02b6237de2f1ab94d5: Deleting consensus metadata
I20260810 18:38:20.823166 29963 ts_tablet_manager.cc:1939] T 955c833ba4e943b687c811718aca1d3c P 9d42319121254539afe309f0e08cd964: Deleting consensus metadata
I20260810 18:38:20.824575 29383 catalog_manager.cc:4841] TS f5edc9a2cd9d4d02b6237de2f1ab94d5 (127.13.139.3:39077): tablet 955c833ba4e943b687c811718aca1d3c (table test-table [id=0bff9d200d784514b899f5fcbe5961fb]) successfully deleted
I20260810 18:38:20.825088 29378 catalog_manager.cc:4841] TS 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659): tablet 955c833ba4e943b687c811718aca1d3c (table test-table [id=0bff9d200d784514b899f5fcbe5961fb]) successfully deleted
Aug 10 18:38:20 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:38:20.826774 29964 ts_tablet_manager.cc:1918] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:20.826965 29964 log.cc:1196] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/955c833ba4e943b687c811718aca1d3c
I20260810 18:38:20.827589 29964 ts_tablet_manager.cc:1939] T 955c833ba4e943b687c811718aca1d3c P dbdf70a038004d9db38d81fdf4fdfbdd: Deleting consensus metadata
I20260810 18:38:20.829026 29383 catalog_manager.cc:4841] TS dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089): tablet 955c833ba4e943b687c811718aca1d3c (table test-table [id=0bff9d200d784514b899f5fcbe5961fb]) successfully deleted
I20260810 18:38:20.834740 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.796856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57548 (local address 127.13.139.1:34659)
0810 18:38:20.797069 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.797078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.806471 (+ 9393us) server_negotiation.cc:407] Connection header received
0810 18:38:20.806992 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.807000 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.807102 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.807181 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:20.810340 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.811660 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.820328 (+ 8668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.821024 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.821136 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:20.827970 (+ 6834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:20.827985 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:20.828003 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:20.828056 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:20.831822 (+ 3766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:20.832571 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:20.832581 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:20.832585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:20.832755 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:20.833163 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:20.833167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:20.833169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:20.833531 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:20.833847 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:20.834165 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 18:38:20.834386 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:38:20.835528 29607 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:20.965826 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 29466
I20260810 18:38:20.986893 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 29620
Aug 10 18:38:20 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:38:21.009974 29936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:20.987832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59106 (local address 127.13.139.2:35089)
0810 18:38:20.988042 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:20.988048 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:20.988071 (+ 23us) server_negotiation.cc:407] Connection header received
0810 18:38:20.988198 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:20.988205 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:20.988297 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:20.988406 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:20.989631 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.990811 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.992417 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:20.993080 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:20.993203 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:21.002110 (+ 8907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:21.002136 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:21.002157 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:21.002212 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:21.006162 (+ 3950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:21.007270 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:21.007281 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:21.007285 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:21.007500 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:21.007964 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:21.007969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:21.007972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:21.008804 (+ 832us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:21.009120 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:21.009341 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 18:38:21.009577 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 18:38:21.010797 29760 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:21.105520 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 29620
I20260810 18:38:21.126422 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 29775
Aug 10 18:38:21 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:38:21.145444 29935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:21.127363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41802 (local address 127.13.139.3:39077)
0810 18:38:21.127601 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:21.127607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:21.127632 (+ 25us) server_negotiation.cc:407] Connection header received
0810 18:38:21.127783 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:21.127789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:21.127877 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:21.128009 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:21.129277 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:21.130503 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:21.132024 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:21.132712 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:21.132870 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:21.137557 (+ 4687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:21.137573 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:21.137594 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:21.137643 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:21.142094 (+ 4451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:21.142896 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:21.142906 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:21.142910 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:21.143102 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:21.143671 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:21.143677 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:21.143680 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:21.144182 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:21.144511 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:21.144794 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 18:38:21.145045 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260810 18:38:21.146279 29912 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:21.271215 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 29775
I20260810 18:38:21.293324 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 29360
I20260810 18:38:21.294538 29430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:21.406275 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 29360
I20260810 18:38:21.432235 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36849
--webserver_interface=127.13.139.62
--webserver_port=35699
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:21.766073 29971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:21.766414 29971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:21.766607 29971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:21.773756 29971 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:21.773865 29971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:21.773912 29971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:21.773964 29971 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:21.774008 29971 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:21.784066 29971 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:36849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=35699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:21.785339 29971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:21.786578 29971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:21.812079 29977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:21.812062 29980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:21.812060 29978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:21.812891 29971 server_base.cc:1034] running on GCE node
I20260810 18:38:21.813794 29971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:21.815531 29971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:21.816813 29971 hybrid_clock.cc:648] HybridClock initialized: now 1786387101816754 us; error 49 us; skew 500 ppm
I20260810 18:38:21.817268 29971 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:21 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387101, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:21.826448 29971 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:21.828347 29971 webserver.cc:460] Webserver started at http://127.13.139.62:35699/ using document root <none> and password file <none>
I20260810 18:38:21.829160 29971 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:21.829339 29971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:21.835693 29971 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 18:38:21.838819 29988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:21.840406 29971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:21.840647 29971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "5618369cc46f48fbbb7bdf2f47d9b58c"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "4a27f261d8b0811c4b482f498c2208aa"
server_key_iv: "653b980e7b2af8c2bcc8111d5d1012d8"
server_key_version: "encryptionkey@0"
I20260810 18:38:21.841853 29971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:21.874992 29971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:21.879288 29971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:21.879626 29971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:21.899233 29971 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:36849
I20260810 18:38:21.899255 30041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:36849 every 8 connection(s)
I20260810 18:38:21.900797 29971 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:21.907892 30042 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:38:21.909317 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 29971
I20260810 18:38:21.910382 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:34659
--local_ip_for_outbound_sockets=127.13.139.1
--tserver_master_addrs=127.13.139.62:36849
--webserver_port=44633
--webserver_interface=127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:38:21.912483 30042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Bootstrap starting.
I20260810 18:38:21.935206 30042 log.cc:824] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:21.948189 30042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:38:21.948743 30042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Bootstrap complete.
I20260810 18:38:21.957934 30042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:21.958828 30042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5618369cc46f48fbbb7bdf2f47d9b58c, State: Initialized, Role: FOLLOWER
I20260810 18:38:21.959482 30042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:21.959728 30042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:38:21.959878 30042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:38:21.960068 30042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 1 FOLLOWER]: Advancing to term 2
I20260810 18:38:21.964041 30042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:21.964561 30042 leader_election.cc:302] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5618369cc46f48fbbb7bdf2f47d9b58c; no voters:
I20260810 18:38:21.965240 30042 leader_election.cc:288] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 18:38:21.965384 30046 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 FOLLOWER]: Leader election won for term 2
I20260810 18:38:21.966169 30046 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 LEADER]: Becoming Leader. State: Replica: 5618369cc46f48fbbb7bdf2f47d9b58c, State: Running, Role: LEADER
I20260810 18:38:21.966837 30046 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:21.967499 30042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:21.969889 30048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } } }
I20260810 18:38:21.969872 30047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5618369cc46f48fbbb7bdf2f47d9b58c. Latest consensus state: current_term: 2 leader_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } } }
I20260810 18:38:21.970330 30048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:21.970373 30047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:21.984683 30052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:21.994313 30052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:21.996236 30052 catalog_manager.cc:1259] Loaded cluster ID: df45abdf7e0a41edbb0975390373466a
I20260810 18:38:21.996431 30052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:38:22.000725 30052 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 18:38:22.025714 30052 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 18:38:22.036494 30052 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:38:22.038241 30052 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Loaded TSK: 0
I20260810 18:38:22.040143 30052 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 18:38:22.273440 30044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:22.273754 30044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:22.273957 30044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:22.281378 30044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:22.281536 30044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:22.281706 30044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:38:22.291817 30044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:34659
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=44633
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:22.293115 30044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:22.294422 30044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:22.309419 30074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:22.310149 30079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:22.310464 30076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:22.311662 30044 server_base.cc:1034] running on GCE node
I20260810 18:38:22.312294 30044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:22.313309 30044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:22.314532 30044 hybrid_clock.cc:648] HybridClock initialized: now 1786387102314472 us; error 55 us; skew 500 ppm
I20260810 18:38:22.314854 30044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:22 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387102, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:22.318100 30044 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:38:22.319813 30044 webserver.cc:460] Webserver started at http://127.13.139.1:44633/ using document root <none> and password file <none>
I20260810 18:38:22.320537 30044 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:22.320681 30044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:22.326169 30044 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 18:38:22.328977 30088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:22.330340 30044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260810 18:38:22.330520 30044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "9d42319121254539afe309f0e08cd964"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "1422852d47648968a45e885640272357"
server_key_iv: "5149929ad7d8a7d032059e4c665d20a5"
server_key_version: "encryptionkey@0"
I20260810 18:38:22.331497 30044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:22.355168 30044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:22.359411 30044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:22.359714 30044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:22.360715 30044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:22.362160 30044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:22.362286 30044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:22.362417 30044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:22.362504 30044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:22.394924 30044 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:34659
I20260810 18:38:22.395056 30211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:34659 every 8 connection(s)
I20260810 18:38:22.396446 30044 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:38:22.400540 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 30044
I20260810 18:38:22.401304 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:35089
--local_ip_for_outbound_sockets=127.13.139.2
--tserver_master_addrs=127.13.139.62:36849
--webserver_port=43777
--webserver_interface=127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:38:22 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387102, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:22.420596 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:22.399311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:33381 (local address 127.13.139.62:36849)
0810 18:38:22.399894 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:22.399906 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:22.402887 (+ 2981us) server_negotiation.cc:407] Connection header received
0810 18:38:22.403161 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:22.403172 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:22.403572 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:22.403912 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:22.405473 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.406927 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.408489 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.409122 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.409316 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:22.413148 (+ 3832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:22.413155 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:22.413168 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:22.413203 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:22.416182 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:22.416914 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:22.416921 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:22.416926 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:22.417087 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:22.417527 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:22.417531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:22.417533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:22.417973 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:22.418192 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:22.418962 (+ 770us) server_negotiation.cc:299] Negotiation successful
0810 18:38:22.419329 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":262,"threads_started":1}
I20260810 18:38:22.420596 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:22.399638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:33381)
0810 18:38:22.400564 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:22.400608 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:22.402582 (+ 1974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:22.404059 (+ 1477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:22.404071 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:22.404691 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:22.405241 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:22.405259 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.407094 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.407098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:22.408348 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:22.408362 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.409357 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.409365 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:22.409634 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:22.410322 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:22.410342 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:22.412894 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:22.416323 (+ 3429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:22.416332 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:22.416345 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:22.416760 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:22.417205 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:22.417210 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:22.417214 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:22.417402 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:22.418114 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:22.418121 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:22.418462 (+ 341us) client_negotiation.cc:769] Sending connection context
0810 18:38:22.418722 (+ 260us) client_negotiation.cc:240] Negotiation successful
0810 18:38:22.419246 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":402,"threads_started":1}
I20260810 18:38:22.423650 30212 heartbeater.cc:347] Connected to a master server at 127.13.139.62:36849
I20260810 18:38:22.423970 30212 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:22.424664 30212 heartbeater.cc:511] Master 127.13.139.62:36849 requested a full tablet report, sending...
I20260810 18:38:22.426738 30005 ts_manager.cc:194] Registered new tserver with Master: 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659)
I20260810 18:38:22.428287 30005 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:33381
W20260810 18:38:22.737277 30217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:22.737591 30217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:22.737756 30217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:22.745277 30217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:22.745417 30217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:22.745592 30217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:38:22.755571 30217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:35089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=43777
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:22.756881 30217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:22.758198 30217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:22.771576 30224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:22.771543 30225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:22.771621 30227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:22.772622 30217 server_base.cc:1034] running on GCE node
I20260810 18:38:22.773276 30217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:22.774236 30217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:22.775525 30217 hybrid_clock.cc:648] HybridClock initialized: now 1786387102775475 us; error 45 us; skew 500 ppm
I20260810 18:38:22.775846 30217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:22 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387102, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:22.779094 30217 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:38:22.780669 30217 webserver.cc:460] Webserver started at http://127.13.139.2:43777/ using document root <none> and password file <none>
I20260810 18:38:22.781348 30217 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:22.781509 30217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:22.787002 30217 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:38:22.789891 30234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:22.791227 30217 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:38:22.791478 30217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "dbdf70a038004d9db38d81fdf4fdfbdd"
format_stamp: "Formatted at 2026-08-10 18:38:19 on dist-test-slave-5k54"
server_key: "cbf05ce038b6c6a4508165986078fd0d"
server_key_iv: "d7a139f6435e226dc953a5b4271411e1"
server_key_version: "encryptionkey@0"
I20260810 18:38:22.792495 30217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:22.808933 30217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:22.813100 30217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:22.813374 30217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:22.814381 30217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:22.815775 30217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:22.815903 30217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:22.816036 30217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:22.816128 30217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:22.851032 30217 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:35089
I20260810 18:38:22.851091 30362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:35089 every 8 connection(s)
I20260810 18:38:22.852582 30217 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:38:22.860533 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 30217
I20260810 18:38:22.861222 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:39077
--local_ip_for_outbound_sockets=127.13.139.3
--tserver_master_addrs=127.13.139.62:36849
--webserver_port=42443
--webserver_interface=127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:38:22 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387102, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:22.876389 30366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:22.855783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:59557)
0810 18:38:22.856541 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:22.856584 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:22.858186 (+ 1602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:22.858811 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:22.858818 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:22.859347 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:22.860245 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:22.860277 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.861634 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.861640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:22.862878 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:22.862890 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.863782 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.863790 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:22.864033 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:22.864753 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:22.864787 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:22.866987 (+ 2200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:22.871042 (+ 4055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:22.871054 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:22.871071 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:22.871792 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:22.872312 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:22.872318 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:22.872322 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:22.872672 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:22.873600 (+ 928us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:22.873610 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:22.874037 (+ 427us) client_negotiation.cc:769] Sending connection context
0810 18:38:22.874331 (+ 294us) client_negotiation.cc:240] Negotiation successful
0810 18:38:22.874890 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":314,"threads_started":1}
I20260810 18:38:22.876734 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:22.855193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:59557 (local address 127.13.139.62:36849)
0810 18:38:22.855408 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:22.855414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:22.856710 (+ 1296us) server_negotiation.cc:407] Connection header received
0810 18:38:22.858440 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:22.858445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:22.858514 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:22.858600 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:22.860453 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.861470 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.863033 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:22.863547 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:22.863681 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:22.867255 (+ 3574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:22.867261 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:22.867264 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:22.867300 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:22.870835 (+ 3535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:22.871945 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:22.871952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:22.871957 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:22.872177 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:22.872814 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:22.872820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:22.872823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:22.873318 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:22.873506 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:22.875757 (+ 2251us) server_negotiation.cc:299] Negotiation successful
0810 18:38:22.876180 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 18:38:22.878893 30363 heartbeater.cc:347] Connected to a master server at 127.13.139.62:36849
I20260810 18:38:22.879314 30363 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:22.880124 30363 heartbeater.cc:511] Master 127.13.139.62:36849 requested a full tablet report, sending...
I20260810 18:38:22.881668 30005 ts_manager.cc:194] Registered new tserver with Master: dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089)
I20260810 18:38:22.882985 30005 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:59557
W20260810 18:38:23.198812 30367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:23.199087 30367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:23.199180 30367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:23.206430 30367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:23.206547 30367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:23.206660 30367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:38:23.216547 30367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:39077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=42443
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:23.217767 30367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:23.219026 30367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:23.232025 30372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:23.232182 30373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:23.232127 30376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:23.233309 30367 server_base.cc:1034] running on GCE node
I20260810 18:38:23.233919 30367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:23.234905 30367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:23.236164 30367 hybrid_clock.cc:648] HybridClock initialized: now 1786387103236114 us; error 43 us; skew 500 ppm
I20260810 18:38:23.236513 30367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:23 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387103, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:23.239778 30367 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:38:23.241343 30367 webserver.cc:460] Webserver started at http://127.13.139.3:42443/ using document root <none> and password file <none>
I20260810 18:38:23.242066 30367 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:23.242228 30367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:23.247856 30367 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 18:38:23.250553 30384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:23.251978 30367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:23.252158 30367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5"
format_stamp: "Formatted at 2026-08-10 18:38:20 on dist-test-slave-5k54"
server_key: "9865b99242f4c200efab1382b24f04cc"
server_key_iv: "532f041f18d4a7166d60cf85e09d1b7c"
server_key_version: "encryptionkey@0"
I20260810 18:38:23.253115 30367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:23.274086 30367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:23.278484 30367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:23.278769 30367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:23.279835 30367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:23.281167 30367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:23.281298 30367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:23.281436 30367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:23.281533 30367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:23.316444 30367 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:39077
I20260810 18:38:23.316534 30509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:39077 every 8 connection(s)
I20260810 18:38:23.317941 30367 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:38:23.323760 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 30367
Aug 10 18:38:23 dist-test-slave-5k54 krb5kdc[29346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387103, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:23.340106 30514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.324838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51082 (local address 127.13.139.62:36849)
0810 18:38:23.325632 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.325640 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.325657 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:38:23.325707 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.325711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.325759 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.325867 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:23.327787 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.328518 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.330239 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.330663 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.330798 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.333882 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:23.333887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:23.333890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:23.333932 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:23.337280 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.337987 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.337991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.337993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.338161 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.338560 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.338567 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.338569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.338828 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:23.339083 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.339384 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.339657 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":532,"threads_started":1}
I20260810 18:38:23.340731 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.320493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:47445 (local address 127.13.139.62:36849)
0810 18:38:23.320721 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.320727 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.321859 (+ 1132us) server_negotiation.cc:407] Connection header received
0810 18:38:23.323991 (+ 2132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.323996 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.324069 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.324151 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:23.326147 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.327320 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.328971 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.329607 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.329732 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.333668 (+ 3936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:23.333674 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:23.333679 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:23.333716 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:23.337016 (+ 3300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.337837 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.337843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.337846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.338017 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.338505 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.338512 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.338519 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.338816 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:23.338956 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.339865 (+ 909us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.340088 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 18:38:23.342412 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.320901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:47445)
0810 18:38:23.321683 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.321721 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:23.323621 (+ 1900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:23.324478 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:23.324487 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:23.325361 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:23.325984 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.326002 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.327551 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.327555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.328837 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.328849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.329874 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.329880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.330067 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.330765 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:23.330799 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:23.333449 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:23.337162 (+ 3713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:23.337172 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:23.337189 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:23.337699 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:23.338128 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:23.338133 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:23.338136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:23.338372 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:23.338967 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:23.338975 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:23.339407 (+ 432us) client_negotiation.cc:769] Sending connection context
0810 18:38:23.340295 (+ 888us) client_negotiation.cc:240] Negotiation successful
0810 18:38:23.340969 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":284,"threads_started":1}
I20260810 18:38:23.343961 30510 heartbeater.cc:347] Connected to a master server at 127.13.139.62:36849
I20260810 18:38:23.344264 30510 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:23.345018 30510 heartbeater.cc:511] Master 127.13.139.62:36849 requested a full tablet report, sending...
I20260810 18:38:23.346510 30005 ts_manager.cc:194] Registered new tserver with Master: f5edc9a2cd9d4d02b6237de2f1ab94d5 (127.13.139.3:39077)
I20260810 18:38:23.347343 30005 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:47445
I20260810 18:38:23.355732 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:38:23.362385 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.356651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51086 (local address 127.13.139.62:36849)
0810 18:38:23.356843 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.356848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.357374 (+ 526us) server_negotiation.cc:407] Connection header received
0810 18:38:23.357567 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.357571 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.357703 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.357866 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:38:23.358235 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.358949 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.360367 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.360786 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.360879 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.361376 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:38:23.361901 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:38:23.362014 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.362130 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.362194 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 18:38:23.363268 30005 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:38:23.370851 30005 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:38:23.392310 30522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.382896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57550)
0810 18:38:23.383749 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.383774 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:23.383889 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:23.384818 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:23.384823 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:23.384854 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:23.385486 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.385504 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.387222 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.387228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.389419 (+ 2191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.389433 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.391227 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.391233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.391453 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.391515 (+ 62us) client_negotiation.cc:769] Sending connection context
0810 18:38:23.391651 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 18:38:23.391833 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":51,"thread_start_us":711,"threads_started":1}
I20260810 18:38:23.392881 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.382544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59108 (local address 127.13.139.2:35089)
0810 18:38:23.383146 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.383155 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.383357 (+ 202us) server_negotiation.cc:407] Connection header received
0810 18:38:23.383797 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.383805 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.384062 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.384258 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:23.385664 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.387121 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.389844 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.391245 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.391370 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.391604 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.392180 (+ 576us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.392372 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":510,"threads_started":1}
I20260810 18:38:23.393081 30523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.383384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57550 (local address 127.13.139.1:34659)
0810 18:38:23.383952 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.383962 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.383991 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:38:23.384094 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.384101 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.384328 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.384527 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:23.385718 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.387091 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.389568 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.391010 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.391155 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.391368 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.392560 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.392744 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":700,"threads_started":1}
I20260810 18:38:23.393582 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.382362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:35089 (local address 127.0.0.1:59108)
0810 18:38:23.383191 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.383233 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:23.383452 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:23.384378 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:23.384386 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:23.384416 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:23.385450 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.385471 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.387299 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.387305 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.389684 (+ 2379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.389699 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.391774 (+ 2075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.391782 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.391957 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.391999 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 18:38:23.393149 (+ 1150us) client_negotiation.cc:240] Negotiation successful
0810 18:38:23.393297 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":57,"thread_start_us":1641,"threads_started":1}
I20260810 18:38:23.394488 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.384339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:39077 (local address 127.0.0.1:41808)
0810 18:38:23.384918 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.384947 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:23.385084 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:23.386245 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:23.386249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:23.386276 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:23.386594 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.386606 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.388568 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.388573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.390525 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.390543 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.392792 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.392798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.392984 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.393019 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:38:23.393104 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 18:38:23.394111 (+ 1007us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":1,"thread_start_us":730,"threads_started":1}
I20260810 18:38:23.395198 30525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.384902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41808 (local address 127.13.139.3:39077)
0810 18:38:23.385647 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.385655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.385685 (+ 30us) server_negotiation.cc:407] Connection header received
0810 18:38:23.385783 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.385791 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.385999 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.386188 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:23.386774 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.388382 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.390715 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.392103 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.392242 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.393990 (+ 1748us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.394074 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.394865 (+ 791us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":1052,"threads_started":1}
I20260810 18:38:23.397171 30142 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8cf39239fd4d999ff2a3cef3a58d27 (DEFAULT_TABLE table=test-table [id=e779169153d544b0a24e0046f46f64c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:23.398828 30142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8cf39239fd4d999ff2a3cef3a58d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:23.398416 30290 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8cf39239fd4d999ff2a3cef3a58d27 (DEFAULT_TABLE table=test-table [id=e779169153d544b0a24e0046f46f64c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:23.398501 30438 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8cf39239fd4d999ff2a3cef3a58d27 (DEFAULT_TABLE table=test-table [id=e779169153d544b0a24e0046f46f64c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:23.399791 30290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8cf39239fd4d999ff2a3cef3a58d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:23.399869 30438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8cf39239fd4d999ff2a3cef3a58d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:23.413110 30526 tablet_bootstrap.cc:492] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Bootstrap starting.
I20260810 18:38:23.415855 30527 tablet_bootstrap.cc:492] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Bootstrap starting.
I20260810 18:38:23.417384 30526 tablet_bootstrap.cc:654] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:23.418664 30526 log.cc:824] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:23.419509 30527 tablet_bootstrap.cc:654] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:23.420117 30528 tablet_bootstrap.cc:492] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Bootstrap starting.
I20260810 18:38:23.420727 30527 log.cc:824] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:23.422255 30526 tablet_bootstrap.cc:492] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: No bootstrap required, opened a new log
I20260810 18:38:23.422526 30526 ts_tablet_manager.cc:1397] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s
I20260810 18:38:23.424165 30528 tablet_bootstrap.cc:654] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:23.424325 30527 tablet_bootstrap.cc:492] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: No bootstrap required, opened a new log
I20260810 18:38:23.424593 30527 ts_tablet_manager.cc:1397] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260810 18:38:23.425215 30528 log.cc:824] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:23.431173 30212 heartbeater.cc:503] Master 127.13.139.62:36849 was elected leader, sending a full tablet report...
I20260810 18:38:23.433135 30526 raft_consensus.cc:348] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.433575 30526 raft_consensus.cc:374] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:23.433686 30526 raft_consensus.cc:729] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5edc9a2cd9d4d02b6237de2f1ab94d5, State: Initialized, Role: FOLLOWER
I20260810 18:38:23.434420 30526 consensus_queue.cc:260] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.435185 30528 tablet_bootstrap.cc:492] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: No bootstrap required, opened a new log
I20260810 18:38:23.435586 30528 ts_tablet_manager.cc:1397] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.008s
I20260810 18:38:23.436411 30527 raft_consensus.cc:348] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.436817 30527 raft_consensus.cc:374] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:23.436930 30527 raft_consensus.cc:729] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d42319121254539afe309f0e08cd964, State: Initialized, Role: FOLLOWER
I20260810 18:38:23.437553 30527 consensus_queue.cc:260] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.439278 30527 ts_tablet_manager.cc:1428] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Time spent starting tablet: real 0.015s user 0.008s sys 0.005s
I20260810 18:38:23.440184 30510 heartbeater.cc:503] Master 127.13.139.62:36849 was elected leader, sending a full tablet report...
I20260810 18:38:23.440898 30526 ts_tablet_manager.cc:1428] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Time spent starting tablet: real 0.018s user 0.019s sys 0.000s
I20260810 18:38:23.446120 30528 raft_consensus.cc:348] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.446484 30528 raft_consensus.cc:374] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:23.446559 30528 raft_consensus.cc:729] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbdf70a038004d9db38d81fdf4fdfbdd, State: Initialized, Role: FOLLOWER
I20260810 18:38:23.447059 30528 consensus_queue.cc:260] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.448053 30363 heartbeater.cc:503] Master 127.13.139.62:36849 was elected leader, sending a full tablet report...
I20260810 18:38:23.448653 30528 ts_tablet_manager.cc:1428] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Time spent starting tablet: real 0.013s user 0.008s sys 0.003s
I20260810 18:38:23.496793 30532 raft_consensus.cc:482] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:38:23.497149 30532 raft_consensus.cc:504] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.498729 30532 leader_election.cc:288] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089), 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659)
I20260810 18:38:23.505879 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.499221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:48221 (local address 127.13.139.2:35089)
0810 18:38:23.499481 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.499487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.499676 (+ 189us) server_negotiation.cc:407] Connection header received
0810 18:38:23.499909 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.499914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.500000 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.500109 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:23.500506 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.501566 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.504104 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.504947 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.505134 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.505209 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.505491 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.505615 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 18:38:23.505885 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.499187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:35089 (local address 127.13.139.3:48221)
0810 18:38:23.499544 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.499581 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:23.499736 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:23.500143 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:23.500148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:23.500174 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:23.500353 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.500361 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.501694 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.501698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.503933 (+ 2235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.503948 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.505120 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.505127 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.505318 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.505346 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 18:38:23.505454 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 18:38:23.505590 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":31}
I20260810 18:38:23.506129 30523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.499187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:59967 (local address 127.13.139.1:34659)
0810 18:38:23.499400 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.499407 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.500097 (+ 690us) server_negotiation.cc:407] Connection header received
0810 18:38:23.500269 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.500274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.500347 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.500418 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:23.501003 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.502009 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.504371 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.505186 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.505362 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.505435 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.505710 (+ 275us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.505840 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:38:23.506260 30535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.499233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.13.139.3:59967)
0810 18:38:23.499995 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.500008 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:23.500134 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:23.500469 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:23.500476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:23.500509 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:23.500833 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.500842 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.502176 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.502182 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.504221 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:23.504230 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.505386 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.505392 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:23.505556 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.505578 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 18:38:23.505680 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 18:38:23.505805 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":25,"thread_start_us":478,"threads_started":1}
I20260810 18:38:23.507265 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cf39239fd4d999ff2a3cef3a58d27" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" is_pre_election: true
I20260810 18:38:23.507264 30164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cf39239fd4d999ff2a3cef3a58d27" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d42319121254539afe309f0e08cd964" is_pre_election: true
I20260810 18:38:23.507804 30312 raft_consensus.cc:2454] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 0.
I20260810 18:38:23.507805 30164 raft_consensus.cc:2454] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 0.
I20260810 18:38:23.508486 30385 leader_election.cc:302] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d42319121254539afe309f0e08cd964, f5edc9a2cd9d4d02b6237de2f1ab94d5; no voters:
I20260810 18:38:23.508885 30532 raft_consensus.cc:2781] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:38:23.509037 30532 raft_consensus.cc:482] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:38:23.509152 30532 raft_consensus.cc:3037] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:23.511370 30532 raft_consensus.cc:504] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.512038 30532 leader_election.cc:288] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 election: Requested vote from peers dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089), 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659)
I20260810 18:38:23.512451 30312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cf39239fd4d999ff2a3cef3a58d27" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd"
I20260810 18:38:23.512490 30164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cf39239fd4d999ff2a3cef3a58d27" candidate_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d42319121254539afe309f0e08cd964"
I20260810 18:38:23.512672 30164 raft_consensus.cc:3037] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:23.512672 30312 raft_consensus.cc:3037] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:23.515985 30312 raft_consensus.cc:2454] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 1.
I20260810 18:38:23.515985 30164 raft_consensus.cc:2454] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5edc9a2cd9d4d02b6237de2f1ab94d5 in term 1.
I20260810 18:38:23.516396 30385 leader_election.cc:302] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d42319121254539afe309f0e08cd964, f5edc9a2cd9d4d02b6237de2f1ab94d5; no voters:
I20260810 18:38:23.516654 30532 raft_consensus.cc:2781] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:23.517093 30532 raft_consensus.cc:686] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 LEADER]: Becoming Leader. State: Replica: f5edc9a2cd9d4d02b6237de2f1ab94d5, State: Running, Role: LEADER
I20260810 18:38:23.517630 30532 consensus_queue.cc:237] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } }
I20260810 18:38:23.521865 30003 catalog_manager.cc:5495] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5edc9a2cd9d4d02b6237de2f1ab94d5 (127.13.139.3). New cstate: current_term: 1 leader_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 } health_report { overall_health: UNKNOWN } } }
I20260810 18:38:23.555917 30525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.550928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41812 (local address 127.13.139.3:39077)
0810 18:38:23.551114 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.551118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.551136 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:38:23.551219 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.551222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.551296 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.551510 (+ 214us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:38:23.551841 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.552579 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.553877 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.554266 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.554359 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.554863 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:38:23.555353 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:38:23.555544 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.555586 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.555650 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:38:23.564134 30312 raft_consensus.cc:1261] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Refusing update from remote peer f5edc9a2cd9d4d02b6237de2f1ab94d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:23.564159 30164 raft_consensus.cc:1261] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Refusing update from remote peer f5edc9a2cd9d4d02b6237de2f1ab94d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:23.565152 30536 consensus_queue.cc:1035] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbdf70a038004d9db38d81fdf4fdfbdd" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 35089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:23.565519 30532 consensus_queue.cc:1035] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d42319121254539afe309f0e08cd964" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 34659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 18:38:23.569494 30511 tablet.cc:2369] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:38:23.577631 30539 mvcc.cc:205] Tried to move back new op lower bound from 7317041576188452864 to 7317041576011886592. Current Snapshot: MvccSnapshot[applied={T|T < 7317041576188452864}]
I20260810 18:38:23.593065 30004 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:23.593374 30004 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:23.597398 30004 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Sending DeleteTablet for 3 replicas of tablet 7d8cf39239fd4d999ff2a3cef3a58d27
I20260810 18:38:23.598503 30290 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8cf39239fd4d999ff2a3cef3a58d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:23 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:59108
I20260810 18:38:23.598575 30438 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8cf39239fd4d999ff2a3cef3a58d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:23 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:41808
I20260810 18:38:23.598858 30142 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8cf39239fd4d999ff2a3cef3a58d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:23 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:57550
I20260810 18:38:23.599920 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 30044
I20260810 18:38:23.614820 30549 tablet_replica.cc:330] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: stopping tablet replica
I20260810 18:38:23.615312 30549 raft_consensus.cc:2229] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:23.615957 30549 raft_consensus.cc:2258] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:23.616763 30551 tablet_replica.cc:330] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: stopping tablet replica
I20260810 18:38:23.617216 30551 raft_consensus.cc:2229] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:23.617722 30551 raft_consensus.cc:2258] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:23.618553 30550 tablet_replica.cc:330] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: stopping tablet replica
I20260810 18:38:23.618561 30549 ts_tablet_manager.cc:1905] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:23.618971 30550 raft_consensus.cc:2229] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:38:23.619634 30550 raft_consensus.cc:2258] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:23.621757 30550 ts_tablet_manager.cc:1905] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:23.621757 30551 ts_tablet_manager.cc:1905] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:23.625672 30549 ts_tablet_manager.cc:1918] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:23.625844 30549 log.cc:1196] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/7d8cf39239fd4d999ff2a3cef3a58d27
I20260810 18:38:23.626484 30549 ts_tablet_manager.cc:1939] T 7d8cf39239fd4d999ff2a3cef3a58d27 P dbdf70a038004d9db38d81fdf4fdfbdd: Deleting consensus metadata
I20260810 18:38:23.628257 30523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.600809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57560 (local address 127.13.139.1:34659)
0810 18:38:23.601176 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.601186 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.601216 (+ 30us) server_negotiation.cc:407] Connection header received
0810 18:38:23.601413 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.601422 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.601575 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.601700 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:23.603994 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.605519 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.608114 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.609080 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.609241 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.617317 (+ 8076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:23.617334 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:23.617350 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:23.617396 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:23.621428 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.622714 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.622723 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.622728 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.622880 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.626359 (+ 3479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.626365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.626368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.626937 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:23.627250 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.627622 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.627875 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 18:38:23.628484 29992 catalog_manager.cc:4841] TS dbdf70a038004d9db38d81fdf4fdfbdd (127.13.139.2:35089): tablet 7d8cf39239fd4d999ff2a3cef3a58d27 (table test-table [id=e779169153d544b0a24e0046f46f64c1]) successfully deleted
I20260810 18:38:23.628955 30206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:23.632453 30550 ts_tablet_manager.cc:1918] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:23.632712 30550 log.cc:1196] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/7d8cf39239fd4d999ff2a3cef3a58d27
I20260810 18:38:23.633260 30550 ts_tablet_manager.cc:1939] T 7d8cf39239fd4d999ff2a3cef3a58d27 P f5edc9a2cd9d4d02b6237de2f1ab94d5: Deleting consensus metadata
I20260810 18:38:23.634931 29992 catalog_manager.cc:4841] TS f5edc9a2cd9d4d02b6237de2f1ab94d5 (127.13.139.3:39077): tablet 7d8cf39239fd4d999ff2a3cef3a58d27 (table test-table [id=e779169153d544b0a24e0046f46f64c1]) successfully deleted
I20260810 18:38:23.722426 30551 ts_tablet_manager.cc:1918] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:23.722718 30551 log.cc:1196] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/7d8cf39239fd4d999ff2a3cef3a58d27
I20260810 18:38:23.723423 30551 ts_tablet_manager.cc:1939] T 7d8cf39239fd4d999ff2a3cef3a58d27 P 9d42319121254539afe309f0e08cd964: Deleting consensus metadata
I20260810 18:38:23.723613 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 30044
W20260810 18:38:23.752069 29989 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:34659 (error 108)
I20260810 18:38:23.752360 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 30217
I20260810 18:38:23.754505 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.753993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57564)
0810 18:38:23.754196 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.754320 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260810 18:38:23.754885 29989 catalog_manager.cc:4584] TS 9d42319121254539afe309f0e08cd964 (127.13.139.1:34659): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d8cf39239fd4d999ff2a3cef3a58d27: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
I20260810 18:38:23.767199 30521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.753674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59114 (local address 127.13.139.2:35089)
0810 18:38:23.753884 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.753891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.753911 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:38:23.753980 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.753985 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.754069 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.754177 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:23.755600 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.756375 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.757750 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.758135 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.758268 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.760986 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:23.760999 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:23.761013 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:23.761050 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:23.764178 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.765024 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.765033 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.765035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.765154 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.765545 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.765551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.765555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.765946 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:23.766248 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.766574 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.766797 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:38:23.767865 30358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:23.808696 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.808098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57576)
0810 18:38:23.808347 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.808496 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260810 18:38:23.810256 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.809815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57584)
0810 18:38:23.809995 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.810104 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 18:38:23.859652 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 30217
I20260810 18:38:23.871224 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.870608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57592)
0810 18:38:23.870867 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.870997 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260810 18:38:23.872484 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.872040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57594)
0810 18:38:23.872224 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.872325 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 18:38:23.880054 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 30367
I20260810 18:38:23.896864 30525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.880910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41824 (local address 127.13.139.3:39077)
0810 18:38:23.881081 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:23.881085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:23.881109 (+ 24us) server_negotiation.cc:407] Connection header received
0810 18:38:23.881320 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:23.881324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:23.881390 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:23.881547 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:23.883701 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.884543 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.886634 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:23.887092 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:23.887188 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:23.890577 (+ 3389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:23.890587 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:23.890602 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:23.890634 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:23.893810 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.894697 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.894704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.894706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.894875 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:23.895280 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:23.895283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:23.895285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:23.895672 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:23.895912 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:23.896330 (+ 418us) server_negotiation.cc:299] Negotiation successful
0810 18:38:23.896510 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:38:23.897620 30505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:23.953298 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.952713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57596)
0810 18:38:23.952976 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.953099 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260810 18:38:23.954486 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:23.954049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57598)
0810 18:38:23.954260 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:23.954343 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260810 18:38:24.022428 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 30367
I20260810 18:38:24.051196 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 29971
I20260810 18:38:24.052539 30037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:24.175190 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:24.174293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:34659 (local address 127.0.0.1:57602)
0810 18:38:24.174620 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:24.174700 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:34659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
I20260810 18:38:24.175510 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 29971
I20260810 18:38:24.200963 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36849
--webserver_interface=127.13.139.62
--webserver_port=35699
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:24.536746 30559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:24.537079 30559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:24.537231 30559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:24.544545 30559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:24.544682 30559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:24.544813 30559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:24.544926 30559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:24.545012 30559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:24.554984 30559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:36849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=35699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:24.556330 30559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:24.557673 30559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:24.569311 30564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:24.569387 30567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:24.569437 30565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:24.570353 30559 server_base.cc:1034] running on GCE node
I20260810 18:38:24.571141 30559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:24.572561 30559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:24.573792 30559 hybrid_clock.cc:648] HybridClock initialized: now 1786387104573730 us; error 69 us; skew 500 ppm
I20260810 18:38:24.574137 30559 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:24 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387104, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:24.577298 30559 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:24.578768 30559 webserver.cc:460] Webserver started at http://127.13.139.62:35699/ using document root <none> and password file <none>
I20260810 18:38:24.579509 30559 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:24.579653 30559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:24.585132 30559 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 18:38:24.587973 30576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:24.589205 30559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:24.589382 30559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "5618369cc46f48fbbb7bdf2f47d9b58c"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "4a27f261d8b0811c4b482f498c2208aa"
server_key_iv: "653b980e7b2af8c2bcc8111d5d1012d8"
server_key_version: "encryptionkey@0"
I20260810 18:38:24.590346 30559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:24.612093 30559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:24.616029 30559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:24.616307 30559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:24.639530 30559 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:36849
I20260810 18:38:24.639565 30636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:36849 every 8 connection(s)
I20260810 18:38:24.641055 30559 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:24.646940 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 30559
I20260810 18:38:24.648026 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:34659
--local_ip_for_outbound_sockets=127.13.139.1
--tserver_master_addrs=127.13.139.62:36849
--webserver_port=44633
--webserver_interface=127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:38:24.648805 30637 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:38:24.654045 30637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Bootstrap starting.
I20260810 18:38:24.676578 30637 log.cc:824] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:24.693071 30637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:38:24.694343 30637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c: Bootstrap complete.
I20260810 18:38:24.709692 30637 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:24.711349 30637 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5618369cc46f48fbbb7bdf2f47d9b58c, State: Initialized, Role: FOLLOWER
I20260810 18:38:24.712023 30637 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:24.712291 30637 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:38:24.712440 30637 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:38:24.712625 30637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 2 FOLLOWER]: Advancing to term 3
I20260810 18:38:24.716686 30637 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:24.717199 30637 leader_election.cc:302] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5618369cc46f48fbbb7bdf2f47d9b58c; no voters:
I20260810 18:38:24.717969 30637 leader_election.cc:288] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 18:38:24.718113 30641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 3 FOLLOWER]: Leader election won for term 3
I20260810 18:38:24.719233 30641 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [term 3 LEADER]: Becoming Leader. State: Replica: 5618369cc46f48fbbb7bdf2f47d9b58c, State: Running, Role: LEADER
I20260810 18:38:24.719820 30641 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } }
I20260810 18:38:24.720331 30637 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:24.722360 30643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5618369cc46f48fbbb7bdf2f47d9b58c. Latest consensus state: current_term: 3 leader_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } } }
I20260810 18:38:24.722748 30643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:24.722466 30642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5618369cc46f48fbbb7bdf2f47d9b58c" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36849 } } }
I20260810 18:38:24.722896 30642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5618369cc46f48fbbb7bdf2f47d9b58c [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:24.735332 30646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:24.744467 30646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:24.746021 30646 catalog_manager.cc:1259] Loaded cluster ID: df45abdf7e0a41edbb0975390373466a
I20260810 18:38:24.746122 30646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 18:38:24.748333 30646 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f076f1119ad google::LogMessage::Fail() at ??:0
@ 0x7f076f11488a google::LogMessage::SendToLog() at ??:0
@ 0x7f076f1114de google::LogMessage::Flush() at ??:0
@ 0x7f076f112a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0784b44512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f0784b41976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0784bc9610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f0784bc9439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0771d5d345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0771d6091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f0771d60799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0771d3beaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f07750156db start_thread at ??:0
@ 0x7f076dfab61f clone at ??:0
W20260810 18:38:25.062381 30639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:25.062669 30639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:25.062767 30639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:25.070171 30639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:25.070297 30639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:25.070421 30639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:38:25.080575 30639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:34659
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=44633
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:25.081943 30639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:25.083489 30639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:25.098400 30682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:25.098291 30683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:25.098362 30685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:25.099318 30639 server_base.cc:1034] running on GCE node
I20260810 18:38:25.099975 30639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:25.100982 30639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:25.102244 30639 hybrid_clock.cc:648] HybridClock initialized: now 1786387105102202 us; error 38 us; skew 500 ppm
I20260810 18:38:25.102645 30639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:25 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387105, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:25.106195 30639 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:38:25.107851 30639 webserver.cc:460] Webserver started at http://127.13.139.1:44633/ using document root <none> and password file <none>
I20260810 18:38:25.108672 30639 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:25.108829 30639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:25.114521 30639 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 18:38:25.117470 30693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:25.119073 30639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:38:25.119335 30639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "9d42319121254539afe309f0e08cd964"
format_stamp: "Formatted at 2026-08-10 18:38:18 on dist-test-slave-5k54"
server_key: "1422852d47648968a45e885640272357"
server_key_iv: "5149929ad7d8a7d032059e4c665d20a5"
server_key_version: "encryptionkey@0"
I20260810 18:38:25.120575 30639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:25.139652 30639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:25.143641 30639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:25.143926 30639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:25.144971 30639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:25.146317 30639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:25.146453 30639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:25.146593 30639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:25.146682 30639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:25.181519 30639 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:34659
I20260810 18:38:25.181618 30822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:34659 every 8 connection(s)
I20260810 18:38:25.183286 30639 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:38:25.188079 30826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:25.186260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:33185)
0810 18:38:25.186970 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:25.187186 (+ 216us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":287,"threads_started":1}
W20260810 18:38:25.188799 30823 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:36849 (0 consecutive failures): Network error: Failed to ping master at 127.13.139.62:36849: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
I20260810 18:38:25.189561 30826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:25.189266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:39307)
0810 18:38:25.189393 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:25.189468 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 18:38:25.190474 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 30639
I20260810 18:38:25.190552 30826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:25.190128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:51831)
0810 18:38:25.190284 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:25.190383 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 18:38:25.190747 30823 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 18:38:25.191256 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:35089
--local_ip_for_outbound_sockets=127.13.139.2
--tserver_master_addrs=127.13.139.62:36849
--webserver_port=43777
--webserver_interface=127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:25.527045 30827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:25.527390 30827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:25.527601 30827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:25.534852 30827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:25.534998 30827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:25.535184 30827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:38:25.544950 30827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:35089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=43777
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:25.546247 30827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:25.547657 30827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:25.560964 30833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:25.561050 30832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:25.561017 30835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:25.561765 30827 server_base.cc:1034] running on GCE node
I20260810 18:38:25.562371 30827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:25.563271 30827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:25.564502 30827 hybrid_clock.cc:648] HybridClock initialized: now 1786387105564449 us; error 64 us; skew 500 ppm
I20260810 18:38:25.564823 30827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:25 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387105, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:25.568274 30827 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:38:25.569690 30827 webserver.cc:460] Webserver started at http://127.13.139.2:43777/ using document root <none> and password file <none>
I20260810 18:38:25.570313 30827 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:25.570417 30827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:25.575570 30827 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:38:25.578117 30843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:25.579596 30827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:25.579794 30827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "dbdf70a038004d9db38d81fdf4fdfbdd"
format_stamp: "Formatted at 2026-08-10 18:38:19 on dist-test-slave-5k54"
server_key: "cbf05ce038b6c6a4508165986078fd0d"
server_key_iv: "d7a139f6435e226dc953a5b4271411e1"
server_key_version: "encryptionkey@0"
I20260810 18:38:25.580772 30827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:25.593080 30827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:25.596943 30827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:25.597221 30827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:25.598193 30827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:25.599529 30827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:25.599640 30827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:25.599771 30827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:25.599865 30827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:25.635008 30827 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:35089
I20260810 18:38:25.635064 30974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:35089 every 8 connection(s)
I20260810 18:38:25.636559 30827 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:38:25.638236 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 30827
I20260810 18:38:25.638976 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:39077
--local_ip_for_outbound_sockets=127.13.139.3
--tserver_master_addrs=127.13.139.62:36849
--webserver_port=42443
--webserver_interface=127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:39565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:38:25.642071 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:25.639835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:42695)
0810 18:38:25.640716 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:25.640990 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":307,"threads_started":1}
W20260810 18:38:25.642838 30975 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:36849 (0 consecutive failures): Network error: Failed to ping master at 127.13.139.62:36849: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
I20260810 18:38:25.643807 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:25.643365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:60675)
0810 18:38:25.643568 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:25.643662 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260810 18:38:25.644805 30977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:25.644365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:54397)
0810 18:38:25.644532 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:25.644633 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 18:38:25.645110 30975 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 18:38:25.966140 30978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:25.966416 30978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:25.966615 30978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:25.973765 30978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:25.973892 30978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:25.974089 30978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:38:25.984093 30978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:39077
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=42443
--tserver_master_addrs=127.13.139.62:36849
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:25.985378 30978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:25.986743 30978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:25.999678 30983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:25.999737 30986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:25.999775 30984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:26.000895 30978 server_base.cc:1034] running on GCE node
I20260810 18:38:26.001487 30978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:26.002377 30978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:26.003535 30978 hybrid_clock.cc:648] HybridClock initialized: now 1786387106003481 us; error 37 us; skew 500 ppm
I20260810 18:38:26.003854 30978 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:26 dist-test-slave-5k54 krb5kdc[29346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387106, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:26.006929 30978 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:38:26.008460 30978 webserver.cc:460] Webserver started at http://127.13.139.3:42443/ using document root <none> and password file <none>
I20260810 18:38:26.009153 30978 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:26.009305 30978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:26.014729 30978 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 18:38:26.017459 30993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:26.018822 30978 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:38:26.019003 30978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "f5edc9a2cd9d4d02b6237de2f1ab94d5"
format_stamp: "Formatted at 2026-08-10 18:38:20 on dist-test-slave-5k54"
server_key: "9865b99242f4c200efab1382b24f04cc"
server_key_iv: "532f041f18d4a7166d60cf85e09d1b7c"
server_key_version: "encryptionkey@0"
I20260810 18:38:26.020035 30978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:26.036391 30978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:26.040237 30978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:26.040518 30978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:26.041498 30978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:26.042783 30978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:26.042918 30978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:26.043056 30978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:26.043149 30978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:26.077602 30978 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:39077
I20260810 18:38:26.077761 31125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:39077 every 8 connection(s)
I20260810 18:38:26.079147 30978 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:38:26.084239 31128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:26.082150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:55799)
0810 18:38:26.082919 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:26.083235 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":291,"threads_started":1}
W20260810 18:38:26.084991 31126 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:36849 (0 consecutive failures): Network error: Failed to ping master at 127.13.139.62:36849: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
I20260810 18:38:26.085850 31128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:26.085500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:54531)
0810 18:38:26.085637 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:26.085732 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 18:38:26.086615 31128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:26.086323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:43665)
0810 18:38:26.086439 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:26.086510 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 18:38:26.086843 31126 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 18:38:26.087322 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 30978
I20260810 18:38:26.192094 31131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:26.191248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:37989)
0810 18:38:26.191749 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:26.191859 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":273,"threads_started":1}
I20260810 18:38:26.646381 31132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:26.645610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:43087)
0810 18:38:26.646054 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:26.646146 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":226,"threads_started":1}
I20260810 18:38:27.088238 31133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:27.087344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:33079)
0810 18:38:27.087891 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:27.088006 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":271,"threads_started":1}
I20260810 18:38:27.193706 31134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:27.193009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:40923)
0810 18:38:27.193464 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:27.193545 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":229,"threads_started":1}
I20260810 18:38:27.648054 31135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:27.647273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:37789)
0810 18:38:27.647798 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:27.647882 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":291,"threads_started":1}
I20260810 18:38:28.089860 31136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:28.089123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:55145)
0810 18:38:28.089590 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:28.089674 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":229,"threads_started":1}
I20260810 18:38:28.195303 31137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:28.194571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:44929)
0810 18:38:28.195017 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:28.195103 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":235,"threads_started":1}
I20260810 18:38:28.649681 31138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:28.649022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:39133)
0810 18:38:28.649434 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:28.649519 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":222,"threads_started":1}
I20260810 18:38:29.091496 31139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:29.090711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:37859)
0810 18:38:29.091197 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:29.091276 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":281,"threads_started":1}
I20260810 18:38:29.196964 31140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:29.196231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:53101)
0810 18:38:29.196679 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:29.196760 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":234,"threads_started":1}
I20260810 18:38:29.651348 31141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:29.650555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:55771)
0810 18:38:29.650983 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:29.651064 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":201,"threads_started":1}
I20260810 18:38:30.093745 31142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:30.092418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:59555)
0810 18:38:30.093364 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:30.093466 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":257,"threads_started":1}
I20260810 18:38:30.198589 31144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:30.197872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:44803)
0810 18:38:30.198331 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:30.198429 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":236,"threads_started":1}
I20260810 18:38:30.653190 31145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:30.652403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:57315)
0810 18:38:30.652895 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:30.653000 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":227,"threads_started":1}
I20260810 18:38:31.095758 31146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:31.094731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:42371)
0810 18:38:31.095373 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:31.095510 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":293,"threads_started":1}
I20260810 18:38:31.200341 31148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:31.199591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:53177)
0810 18:38:31.200077 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:31.200172 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":267,"threads_started":1}
I20260810 18:38:31.654807 31149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:31.654079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:51777)
0810 18:38:31.654550 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:31.654642 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":253,"threads_started":1}
I20260810 18:38:32.097564 31150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:32.096732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:52009)
0810 18:38:32.097306 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:32.097394 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":332,"threads_started":1}
I20260810 18:38:32.202129 31151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:32.201330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:60063)
0810 18:38:32.201807 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:32.201919 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":230,"threads_started":1}
I20260810 18:38:32.656592 31152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:32.655792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:48205)
0810 18:38:32.656256 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:32.656340 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":213,"threads_started":1}
I20260810 18:38:33.099229 31153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:33.098408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:41783)
0810 18:38:33.098933 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:33.099015 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":233,"threads_started":1}
I20260810 18:38:33.203938 31154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:33.203123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:39639)
0810 18:38:33.203680 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:33.203767 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":337,"threads_started":1}
I20260810 18:38:33.658398 31155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:33.657643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:45581)
0810 18:38:33.658139 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:33.658221 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":292,"threads_started":1}
I20260810 18:38:34.101436 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:34.100405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:44311)
0810 18:38:34.101035 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:34.101157 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":294,"threads_started":1}
I20260810 18:38:34.205508 31158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:34.204810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:39443)
0810 18:38:34.205255 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:34.205334 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":223,"threads_started":1}
I20260810 18:38:34.660116 31159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:34.659344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:59967)
0810 18:38:34.659846 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:34.659946 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":272,"threads_started":1}
I20260810 18:38:35.103217 31161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:35.102439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:40765)
0810 18:38:35.102947 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:35.103035 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":247,"threads_started":1}
I20260810 18:38:35.207324 31162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:35.206507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:45525)
0810 18:38:35.207084 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:35.207163 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":315,"threads_started":1}
I20260810 18:38:35.661795 31163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:35.661092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:50417)
0810 18:38:35.661555 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:35.661636 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":266,"threads_started":1}
I20260810 18:38:36.105350 31164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:36.104354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:44907)
0810 18:38:36.104980 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:36.105094 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":336,"threads_started":1}
I20260810 18:38:36.209071 31165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:36.208306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:39563)
0810 18:38:36.208765 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:36.208860 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":240,"threads_started":1}
I20260810 18:38:36.663578 31166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:36.662786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:33633)
0810 18:38:36.663242 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:36.663324 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":233,"threads_started":1}
I20260810 18:38:37.107147 31167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:37.106378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:58667)
0810 18:38:37.106860 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:37.106962 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":231,"threads_started":1}
I20260810 18:38:37.210948 31168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:37.210160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:44605)
0810 18:38:37.210700 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:37.210782 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":313,"threads_started":1}
I20260810 18:38:37.665370 31169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:37.664543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:33339)
0810 18:38:37.665113 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:37.665208 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":312,"threads_started":1}
I20260810 18:38:38.109167 31170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:38.108201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:50059)
0810 18:38:38.108776 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:38.108953 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":333,"threads_started":1}
I20260810 18:38:38.212745 31171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:38.211965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:45491)
0810 18:38:38.212464 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:38.212557 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":241,"threads_started":1}
I20260810 18:38:38.667130 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:38.666347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:38431)
0810 18:38:38.666819 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:38.666956 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":231,"threads_started":1}
I20260810 18:38:39.110998 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:39.110209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:54579)
0810 18:38:39.110702 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:39.110798 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":245,"threads_started":1}
I20260810 18:38:39.214375 31175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:39.213677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:45819)
0810 18:38:39.214107 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:39.214191 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":221,"threads_started":1}
I20260810 18:38:39.668963 31176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:39.668096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:34547)
0810 18:38:39.668558 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:39.668664 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":227,"threads_started":1}
I20260810 18:38:40.112751 31177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:40.112043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:39679)
0810 18:38:40.112486 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:40.112570 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":217,"threads_started":1}
I20260810 18:38:40.216367 31178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:40.215575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:32815)
0810 18:38:40.216084 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:40.216180 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":226,"threads_started":1}
I20260810 18:38:40.671106 31179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:40.670272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.2:58377)
0810 18:38:40.670785 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:40.670930 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":264,"threads_started":1}
I20260810 18:38:41.100996 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 30639
I20260810 18:38:41.114908 31181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:41.114190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.3:58329)
0810 18:38:41.114632 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:41.114724 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":219,"threads_started":1}
I20260810 18:38:41.218354 31182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:41.217376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36849 (local address 127.13.139.1:54403)
0810 18:38:41.217910 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:41.218086 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:36849: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":286,"threads_started":1}
I20260810 18:38:41.225560 31180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:41.102289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49766 (local address 127.13.139.1:34659)
0810 18:38:41.102938 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:41.102958 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:41.204221 (+101263us) server_negotiation.cc:407] Connection header received
0810 18:38:41.206001 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:41.206010 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:41.206460 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:41.206823 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:41.208522 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:41.209787 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:41.211084 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:41.211863 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:41.212067 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:41.218957 (+ 6890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:41.218966 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:41.218985 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:41.219029 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:41.221844 (+ 2815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:41.222584 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:41.222592 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:41.222598 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:41.222783 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:41.223204 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:41.223209 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:41.223210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:41.223878 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:41.224225 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:41.224657 (+ 432us) server_negotiation.cc:299] Negotiation successful
0810 18:38:41.225265 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":314,"threads_started":1}
I20260810 18:38:41.226943 30818 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:41.311111 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 30639
I20260810 18:38:41.333067 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 30827
I20260810 18:38:41.351645 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:41.334109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43822 (local address 127.13.139.2:35089)
0810 18:38:41.334658 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:41.334673 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:41.334710 (+ 37us) server_negotiation.cc:407] Connection header received
0810 18:38:41.336376 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:41.336386 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:41.336816 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:41.337182 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:41.338653 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:41.340010 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:41.341420 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:41.342098 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:41.342241 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:41.345297 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:41.345305 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:41.345320 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:41.345362 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:41.348428 (+ 3066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:41.349093 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:41.349100 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:41.349106 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:41.349268 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:41.349641 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:41.349644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:41.349646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:41.350141 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:41.350365 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:41.350791 (+ 426us) server_negotiation.cc:299] Negotiation successful
0810 18:38:41.351145 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":262,"threads_started":1}
I20260810 18:38:41.353076 30970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:41.438452 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 30827
I20260810 18:38:41.459849 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 30978
I20260810 18:38:41.477995 31187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:41.460843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34978 (local address 127.13.139.3:39077)
0810 18:38:41.461488 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:41.461504 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:41.461546 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:38:41.463203 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:41.463213 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:41.463725 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:41.464016 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:41.465376 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:41.466593 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:41.468232 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:41.468973 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:41.469115 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:41.471784 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:41.471795 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:41.471815 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:41.471856 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:41.474691 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:41.475377 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:41.475383 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:41.475389 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:41.475867 (+ 478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:41.476190 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:41.476193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:41.476195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:41.476694 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:41.476957 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:41.477242 (+ 285us) server_negotiation.cc:299] Negotiation successful
0810 18:38:41.477675 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":304,"threads_started":1}
I20260810 18:38:41.479490 31121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:41.564246 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 30978
2026-08-10T18:38:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25392 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:38:41 dist-test-slave-5k54 krb5kdc[31191](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:38:41 dist-test-slave-5k54 krb5kdc[31191](info): set up 2 sockets
Aug 10 18:38:41 dist-test-slave-5k54 krb5kdc[31191](info): commencing operation
krb5kdc: starting...
W20260810 18:38:42.748332 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:38:42 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:38:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:38:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:38:43.031562 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46635
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:46635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:43.376893 31206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:43.377209 31206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:43.377305 31206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:43.385027 31206 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 18:38:43.385161 31206 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 18:38:43.385223 31206 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 18:38:43.385298 31206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:38:43.385383 31206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:43.385500 31206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:43.385553 31206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:38:43.385608 31206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:38:43.395928 31206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:46635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:43.397272 31206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:43.398625 31206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:43.411365 31212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:43.411320 31215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:43.411391 31213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:43.412447 31206 server_base.cc:1034] running on GCE node
I20260810 18:38:43.413333 31206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:43.414817 31206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:43.416107 31206 hybrid_clock.cc:648] HybridClock initialized: now 1786387123416021 us; error 61 us; skew 500 ppm
I20260810 18:38:43.416471 31206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:43 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387123, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:43.419827 31206 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:38:43.421420 31206 webserver.cc:460] Webserver started at http://127.13.139.62:39037/ using document root <none> and password file <none>
I20260810 18:38:43.422243 31206 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:43.422387 31206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:43.422712 31206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:43.425925 31206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "d12dea8182324a9eb0efe8e528a524be"
format_stamp: "Formatted at 2026-08-10 18:38:43 on dist-test-slave-5k54"
server_key: "727a2632436061cf515c4ecd13996190"
server_key_iv: "db1dbbc6c029a635514ddbfb473445f5"
server_key_version: "encryptionkey@0"
I20260810 18:38:43.426759 31206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "d12dea8182324a9eb0efe8e528a524be"
format_stamp: "Formatted at 2026-08-10 18:38:43 on dist-test-slave-5k54"
server_key: "727a2632436061cf515c4ecd13996190"
server_key_iv: "db1dbbc6c029a635514ddbfb473445f5"
server_key_version: "encryptionkey@0"
I20260810 18:38:43.432260 31206 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260810 18:38:43.435968 31223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:43.437330 31206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:38:43.437527 31206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "d12dea8182324a9eb0efe8e528a524be"
format_stamp: "Formatted at 2026-08-10 18:38:43 on dist-test-slave-5k54"
server_key: "727a2632436061cf515c4ecd13996190"
server_key_iv: "db1dbbc6c029a635514ddbfb473445f5"
server_key_version: "encryptionkey@0"
I20260810 18:38:43.437767 31206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:43.469826 31206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:43.474064 31206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:43.474346 31206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:43.493875 31206 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:46635
I20260810 18:38:43.493897 31283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:46635 every 8 connection(s)
I20260810 18:38:43.495267 31206 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:38:43.499171 31284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:43.500082 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 31206
I20260810 18:38:43.500335 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:38:43.501047 13868 external_mini_cluster.cc:1428] Setting key 58500c18694a4be57b7664e739b34bba
I20260810 18:38:43.513983 31284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Bootstrap starting.
Aug 10 18:38:43 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:43.517356 31284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:43.518790 31284 log.cc:824] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:43.522645 31284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: No bootstrap required, opened a new log
I20260810 18:38:43.527374 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:43.503228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36492 (local address 127.13.139.62:46635)
0810 18:38:43.504147 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:43.504169 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:43.504221 (+ 52us) server_negotiation.cc:407] Connection header received
0810 18:38:43.506120 (+ 1899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:43.506149 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:43.506663 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:43.507133 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:43.508543 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:43.510589 (+ 2046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:43.512037 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:43.513081 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:43.513252 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:43.517802 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:43.517816 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:43.517849 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:43.517907 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:43.522338 (+ 4431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:43.523214 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:43.523222 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:43.523231 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:43.523487 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:43.523941 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:43.523946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:43.523949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:43.524719 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:43.525080 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:43.525429 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 18:38:43.525936 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":415,"threads_started":1}
I20260810 18:38:43.532632 31284 raft_consensus.cc:348] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:38:43.533026 31284 raft_consensus.cc:374] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:43.533138 31284 raft_consensus.cc:729] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d12dea8182324a9eb0efe8e528a524be, State: Initialized, Role: FOLLOWER
I20260810 18:38:43.533849 31284 consensus_queue.cc:260] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:38:43.534070 31284 raft_consensus.cc:388] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:38:43.534170 31284 raft_consensus.cc:482] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:38:43.534301 31284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:43.536649 31284 raft_consensus.cc:504] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:38:43.537179 31284 leader_election.cc:302] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d12dea8182324a9eb0efe8e528a524be; no voters:
I20260810 18:38:43.537773 31284 leader_election.cc:288] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:38:43.537891 31289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:43.538708 31289 raft_consensus.cc:686] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 LEADER]: Becoming Leader. State: Replica: d12dea8182324a9eb0efe8e528a524be, State: Running, Role: LEADER
I20260810 18:38:43.539211 31289 consensus_queue.cc:237] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:38:43.539999 31284 sys_catalog.cc:564] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:38:43.542164 31293 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: SysCatalogTable state changed. Reason: New leader d12dea8182324a9eb0efe8e528a524be. Latest consensus state: current_term: 1 leader_uuid: "d12dea8182324a9eb0efe8e528a524be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } } }
I20260810 18:38:43.542289 31290 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d12dea8182324a9eb0efe8e528a524be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } } }
I20260810 18:38:43.542596 31293 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:43.542739 31290 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: This master's current role is: LEADER
I20260810 18:38:43.544644 31297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:38:43.549126 31297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:38:43.558218 31297 catalog_manager.cc:1347] Generated new cluster ID: 35dceb4013544055b0dfad955108881b
I20260810 18:38:43.558332 31297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:38:43.577888 31297 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:38:43.579854 31297 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:38:43.595250 31297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Generated new TSK 0
I20260810 18:38:43.596424 31297 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:38:43.663746 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46635
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:44.004806 31313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:44.005089 31313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:44.005187 31313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:44.012708 31313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:44.012827 31313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:44.012944 31313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:38:44.022666 31313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:44.023965 31313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:44.025251 31313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:44.038379 31319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:44.038426 31320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:44.038628 31323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:44.039225 31313 server_base.cc:1034] running on GCE node
I20260810 18:38:44.039961 31313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:44.040978 31313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:44.042246 31313 hybrid_clock.cc:648] HybridClock initialized: now 1786387124042128 us; error 98 us; skew 500 ppm
I20260810 18:38:44.042582 31313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:44 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387124, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:44.045851 31313 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:38:44.047187 31313 webserver.cc:460] Webserver started at http://127.13.139.1:46329/ using document root <none> and password file <none>
I20260810 18:38:44.047920 31313 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:44.048055 31313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:44.048362 31313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:44.051221 31313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "3f3666ad3314418bac2d8a50d5f6f2d8"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "6fad8bc63c9b64895ef45b4a4ac32139"
server_key_iv: "4f75057c79c06a96c5598aaf1eb89220"
server_key_version: "encryptionkey@0"
I20260810 18:38:44.052039 31313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "3f3666ad3314418bac2d8a50d5f6f2d8"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "6fad8bc63c9b64895ef45b4a4ac32139"
server_key_iv: "4f75057c79c06a96c5598aaf1eb89220"
server_key_version: "encryptionkey@0"
I20260810 18:38:44.057015 31313 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:38:44.060416 31330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:44.061717 31313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:38:44.061897 31313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "3f3666ad3314418bac2d8a50d5f6f2d8"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "6fad8bc63c9b64895ef45b4a4ac32139"
server_key_iv: "4f75057c79c06a96c5598aaf1eb89220"
server_key_version: "encryptionkey@0"
I20260810 18:38:44.062100 31313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:44.078557 31313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:44.082940 31313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:44.083237 31313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:44.084208 31313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:44.085557 31313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:44.085631 31313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:44.085760 31313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:44.085822 31313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:44.118357 31313 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:43311
I20260810 18:38:44.120307 31313 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:38:44.120566 31458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:43311 every 8 connection(s)
I20260810 18:38:44.123070 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 31313
I20260810 18:38:44.123308 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:38:44.124332 13868 external_mini_cluster.cc:1428] Setting key 4587a1ec16b14ea374de716060e90b13
Aug 10 18:38:44 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387124, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:44.148531 31461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:44.123511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:52253 (local address 127.13.139.62:46635)
0810 18:38:44.124042 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:44.124051 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:44.125099 (+ 1048us) server_negotiation.cc:407] Connection header received
0810 18:38:44.127406 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:44.127414 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:44.127537 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:44.127648 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:44.130342 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.131632 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.134166 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.134874 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.135028 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:44.140243 (+ 5215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:44.140252 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:44.140260 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:44.140306 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:44.144441 (+ 4135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:44.145488 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:44.145494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:44.145499 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:44.145654 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:44.146227 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:44.146233 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:44.146237 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:44.146595 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:44.146742 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:44.147915 (+ 1173us) server_negotiation.cc:299] Negotiation successful
0810 18:38:44.148143 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":764,"threads_started":1}
I20260810 18:38:44.149956 31462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:44.123916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:52253)
0810 18:38:44.124923 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:44.124985 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:44.127142 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:44.128076 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:44.128091 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:44.129354 (+ 1263us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:44.130149 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:44.130176 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.131818 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.131826 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:44.133991 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:44.134010 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.135136 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.135145 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:44.135512 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:44.136346 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:44.136386 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:44.139984 (+ 3598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:44.144626 (+ 4642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:44.144637 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:44.144658 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:44.145319 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:44.145803 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:44.145810 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:44.145813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:44.146085 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:44.146832 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:44.146844 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:44.147447 (+ 603us) client_negotiation.cc:769] Sending connection context
0810 18:38:44.147813 (+ 366us) client_negotiation.cc:240] Negotiation successful
0810 18:38:44.148359 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":422,"threads_started":1}
I20260810 18:38:44.151934 31459 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46635
I20260810 18:38:44.152299 31459 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:44.153229 31459 heartbeater.cc:511] Master 127.13.139.62:46635 requested a full tablet report, sending...
I20260810 18:38:44.155886 31245 ts_manager.cc:194] Registered new tserver with Master: 3f3666ad3314418bac2d8a50d5f6f2d8 (127.13.139.1:43311)
I20260810 18:38:44.158134 31245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:52253
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:38:44.196810 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46635
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:44.527789 31465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:44.528052 31465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:44.528201 31465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:44.535303 31465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:44.535403 31465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:44.535622 31465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:38:44.545650 31465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:44.547266 31465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:44.548637 31465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:44.561760 31470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:44.561866 31471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:44.561826 31473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:44.562769 31465 server_base.cc:1034] running on GCE node
I20260810 18:38:44.563334 31465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:44.564343 31465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:44.565538 31465 hybrid_clock.cc:648] HybridClock initialized: now 1786387124565480 us; error 48 us; skew 500 ppm
I20260810 18:38:44.565801 31465 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:44 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387124, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:44.569126 31465 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:38:44.570550 31465 webserver.cc:460] Webserver started at http://127.13.139.2:40821/ using document root <none> and password file <none>
I20260810 18:38:44.571237 31465 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:44.571370 31465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:44.571714 31465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:44.574589 31465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "a5fa59ef678e440489df745d357caaa4"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "eb5e28ac65462818431c0a5c2ede635f"
server_key_iv: "faf23b6785f76a44bdbd3a8f9f5dc144"
server_key_version: "encryptionkey@0"
I20260810 18:38:44.575353 31465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "a5fa59ef678e440489df745d357caaa4"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "eb5e28ac65462818431c0a5c2ede635f"
server_key_iv: "faf23b6785f76a44bdbd3a8f9f5dc144"
server_key_version: "encryptionkey@0"
I20260810 18:38:44.580518 31465 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:38:44.583909 31482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:44.585260 31465 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260810 18:38:44.585429 31465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "a5fa59ef678e440489df745d357caaa4"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "eb5e28ac65462818431c0a5c2ede635f"
server_key_iv: "faf23b6785f76a44bdbd3a8f9f5dc144"
server_key_version: "encryptionkey@0"
I20260810 18:38:44.585632 31465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:44.613535 31465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:44.618171 31465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:44.618479 31465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:44.619655 31465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:44.621002 31465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:44.621106 31465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:44.621251 31465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:44.621325 31465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:44.655821 31465 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:43145
I20260810 18:38:44.655910 31609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:43145 every 8 connection(s)
I20260810 18:38:44.657321 31465 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:38:44.663807 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 31465
I20260810 18:38:44.664018 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:38:44.664517 13868 external_mini_cluster.cc:1428] Setting key c17402864f6c02326936207604f44975
Aug 10 18:38:44 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387124, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:44.682322 31612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:44.661545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:59271 (local address 127.13.139.62:46635)
0810 18:38:44.665508 (+ 3963us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:44.665514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:44.665535 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:38:44.666636 (+ 1101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:44.666643 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:44.666726 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:44.666853 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:44.668975 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.669864 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.671403 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.671855 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.671999 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:44.675699 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:44.675708 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:44.675715 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:44.675762 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:44.679063 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:44.680057 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:44.680060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:44.680063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:44.680187 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:44.680664 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:44.680667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:44.680669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:44.680941 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:44.681057 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:44.681900 (+ 843us) server_negotiation.cc:299] Negotiation successful
0810 18:38:44.682055 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3843,"thread_start_us":3640,"threads_started":1}
I20260810 18:38:44.683934 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:44.662192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:59271)
0810 18:38:44.663225 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:44.663291 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:44.666139 (+ 2848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:44.667120 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:44.667128 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:44.667863 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:44.668736 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:44.668785 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.670025 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.670030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:44.671248 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:44.671265 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:44.672084 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:44.672093 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:44.672339 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:44.673034 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:44.673056 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:44.675404 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:44.679204 (+ 3800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:44.679216 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:44.679234 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:44.679911 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:44.680294 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:44.680301 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:44.680307 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:44.680548 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:44.681059 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:44.681069 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:44.681504 (+ 435us) client_negotiation.cc:769] Sending connection context
0810 18:38:44.681803 (+ 299us) client_negotiation.cc:240] Negotiation successful
0810 18:38:44.682362 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":362,"threads_started":1}
I20260810 18:38:44.685519 31610 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46635
I20260810 18:38:44.685922 31610 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:44.686674 31610 heartbeater.cc:511] Master 127.13.139.62:46635 requested a full tablet report, sending...
I20260810 18:38:44.688397 31245 ts_manager.cc:194] Registered new tserver with Master: a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145)
I20260810 18:38:44.689334 31245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:59271
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:38:44.730687 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46635
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:38:45.071472 31616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:38:45.071779 31616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:38:45.071887 31616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:38:45.080029 31616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:38:45.080142 31616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:38:45.080265 31616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:38:45.090929 31616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:38:45.092139 31616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:38:45.093398 31616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:38:45.106236 31621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:45.106150 31622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:38:45.106199 31625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:38:45.107195 31616 server_base.cc:1034] running on GCE node
I20260810 18:38:45.107824 31616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:38:45.108747 31616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:38:45.109949 31616 hybrid_clock.cc:648] HybridClock initialized: now 1786387125109878 us; error 55 us; skew 500 ppm
I20260810 18:38:45.110220 31616 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:38:45 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387125, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:38:45.113577 31616 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:38:45.115070 31616 webserver.cc:460] Webserver started at http://127.13.139.3:35539/ using document root <none> and password file <none>
I20260810 18:38:45.115871 31616 fs_manager.cc:359] Metadata directory not provided
I20260810 18:38:45.116015 31616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:38:45.116348 31616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:38:45.119587 31616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "69dabe2e916e42adb4a757f51af9b32f"
format_stamp: "Formatted at 2026-08-10 18:38:45 on dist-test-slave-5k54"
server_key: "3d07f496394402e52c4866eaa28a9455"
server_key_iv: "2f73382c82f71b8eafbe95338d8e203e"
server_key_version: "encryptionkey@0"
I20260810 18:38:45.120353 31616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "69dabe2e916e42adb4a757f51af9b32f"
format_stamp: "Formatted at 2026-08-10 18:38:45 on dist-test-slave-5k54"
server_key: "3d07f496394402e52c4866eaa28a9455"
server_key_iv: "2f73382c82f71b8eafbe95338d8e203e"
server_key_version: "encryptionkey@0"
I20260810 18:38:45.125758 31616 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:38:45.129251 31633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:45.130635 31616 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:38:45.130818 31616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "69dabe2e916e42adb4a757f51af9b32f"
format_stamp: "Formatted at 2026-08-10 18:38:45 on dist-test-slave-5k54"
server_key: "3d07f496394402e52c4866eaa28a9455"
server_key_iv: "2f73382c82f71b8eafbe95338d8e203e"
server_key_version: "encryptionkey@0"
I20260810 18:38:45.131033 31616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:38:45.150758 31616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:38:45.155387 31616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:38:45.155769 31616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:38:45.156749 31616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:38:45.158295 31616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:38:45.158401 31616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:45.158555 31616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:38:45.158628 31616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:38:45.162755 31459 heartbeater.cc:503] Master 127.13.139.62:46635 was elected leader, sending a full tablet report...
I20260810 18:38:45.194458 31616 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:40757
I20260810 18:38:45.194509 31758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:40757 every 8 connection(s)
I20260810 18:38:45.195815 31616 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:38:45.197503 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 31616
I20260810 18:38:45.197713 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:38:45.198246 13868 external_mini_cluster.cc:1428] Setting key 172ddebc136e28cf06624cc088a0be7f
Aug 10 18:38:45 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387125, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:38:45.217459 31761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.198614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:34237 (local address 127.13.139.62:46635)
0810 18:38:45.199139 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.199145 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.200149 (+ 1004us) server_negotiation.cc:407] Connection header received
0810 18:38:45.202497 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.202502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.202602 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.202730 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:45.204299 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.205076 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.206674 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.207113 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.207253 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.211032 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:45.211038 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:45.211043 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:45.211086 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:45.214314 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.215034 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.215045 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.215048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.215164 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.215679 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.215686 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.215694 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.215965 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:45.216137 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.216836 (+ 699us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.217067 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":240,"threads_started":1}
I20260810 18:38:45.218457 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.199135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:34237)
0810 18:38:45.200004 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.200041 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:45.202220 (+ 2179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:45.202977 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:45.202986 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:45.203579 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:38:45.204125 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.204149 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.205237 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.205241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.206530 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.206542 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.207348 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.207358 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.207641 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.208300 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:38:45.208326 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:38:45.210806 (+ 2480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:38:45.214452 (+ 3646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:45.214460 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:45.214477 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:45.214895 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:45.215276 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:38:45.215281 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:38:45.215285 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:38:45.215560 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:38:45.216095 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:38:45.216104 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:38:45.216468 (+ 364us) client_negotiation.cc:769] Sending connection context
0810 18:38:45.216732 (+ 264us) client_negotiation.cc:240] Negotiation successful
0810 18:38:45.217284 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":340,"threads_started":1}
I20260810 18:38:45.219813 31759 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46635
I20260810 18:38:45.220109 31759 heartbeater.cc:464] Registering TS with master...
I20260810 18:38:45.220816 31759 heartbeater.cc:511] Master 127.13.139.62:46635 requested a full tablet report, sending...
I20260810 18:38:45.222208 31245 ts_manager.cc:194] Registered new tserver with Master: 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
I20260810 18:38:45.223026 31245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:34237
I20260810 18:38:45.226296 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:38:45.244334 31761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.230840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36350 (local address 127.13.139.62:46635)
0810 18:38:45.231055 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.231064 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.231502 (+ 438us) server_negotiation.cc:407] Connection header received
0810 18:38:45.231686 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.231690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.231752 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.231830 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:45.233896 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.234689 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.236201 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.236593 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.236688 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.238959 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:45.238964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:45.238967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:45.238997 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:45.241873 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.242547 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.242551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.242553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.242669 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.243018 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.243021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.243023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.243321 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:45.243565 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.243828 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.243993 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:38:45.248315 31245 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36350:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:38:45.255402 31245 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:38:45.287953 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.267656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:43145 (local address 127.0.0.1:40200)
0810 18:38:45.277854 (+ 10198us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.277879 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:45.278052 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:45.280584 (+ 2532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:45.280592 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:45.280623 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:45.281053 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.281066 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.282792 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.282800 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.285053 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.285068 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.286895 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.286902 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.287083 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.287146 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 18:38:45.287289 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 18:38:45.287532 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10014,"mutex_wait_us":47,"thread_start_us":9628,"threads_started":1}
I20260810 18:38:45.287920 31779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.268188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40200 (local address 127.13.139.2:43145)
0810 18:38:45.280041 (+ 11853us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.280047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.280071 (+ 24us) server_negotiation.cc:407] Connection header received
0810 18:38:45.280150 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.280155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.280349 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.280565 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:45.281271 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.282658 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.285264 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.286708 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.286878 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.287078 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.287333 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.287532 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11712,"thread_start_us":11563,"threads_started":1}
I20260810 18:38:45.289072 31776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.267563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53216)
0810 18:38:45.277712 (+ 10149us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.277751 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:45.277976 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:45.281065 (+ 3089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:45.281070 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:45.281099 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:45.281569 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.281583 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.283881 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.283886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.286422 (+ 2536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.286440 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.288301 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.288307 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.288489 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.288522 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 18:38:45.288574 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 18:38:45.288674 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9878,"mutex_wait_us":81,"thread_start_us":13204,"threads_started":1}
I20260810 18:38:45.289129 31781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.268773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55238 (local address 127.13.139.3:40757)
0810 18:38:45.279556 (+ 10783us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.279570 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.280683 (+ 1113us) server_negotiation.cc:407] Connection header received
0810 18:38:45.280787 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.280794 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.281012 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.281197 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:45.282210 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.283819 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.286262 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.287643 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.287770 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.288017 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.288582 (+ 565us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.288806 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10541,"thread_start_us":10358,"threads_started":1}
I20260810 18:38:45.289887 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.268151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:40757 (local address 127.0.0.1:55238)
0810 18:38:45.280418 (+ 12267us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.280436 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:45.280549 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:45.281510 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:45.281519 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:45.281547 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:45.282009 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.282022 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.283979 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.283986 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.286107 (+ 2121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.286119 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.288171 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.288180 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.288379 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.288414 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:38:45.288508 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 18:38:45.288639 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12155,"mutex_wait_us":85,"thread_start_us":10017,"threads_started":1}
I20260810 18:38:45.290241 31780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.268288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53216 (local address 127.13.139.1:43311)
0810 18:38:45.280212 (+ 11924us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.280222 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.280253 (+ 31us) server_negotiation.cc:407] Connection header received
0810 18:38:45.280354 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.280362 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.280615 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.281812 (+ 1197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:45.282087 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.283734 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.286597 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.288071 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.289423 (+ 1352us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.289650 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.289719 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.289899 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11735,"thread_start_us":11550,"threads_started":1}
I20260810 18:38:45.293079 31687 tablet_service.cc:1467] Processing CreateTablet for tablet 3db3b0a8809b47ed9e18eeac936e7001 (DEFAULT_TABLE table=test-table [id=eef95ddab75b4e11a8a31e1d97ca42d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:45.293133 31539 tablet_service.cc:1467] Processing CreateTablet for tablet 3db3b0a8809b47ed9e18eeac936e7001 (DEFAULT_TABLE table=test-table [id=eef95ddab75b4e11a8a31e1d97ca42d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:45.293639 31388 tablet_service.cc:1467] Processing CreateTablet for tablet 3db3b0a8809b47ed9e18eeac936e7001 (DEFAULT_TABLE table=test-table [id=eef95ddab75b4e11a8a31e1d97ca42d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:38:45.294560 31687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3db3b0a8809b47ed9e18eeac936e7001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:45.294565 31539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3db3b0a8809b47ed9e18eeac936e7001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:45.295011 31388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3db3b0a8809b47ed9e18eeac936e7001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:38:45.305540 31782 tablet_bootstrap.cc:492] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Bootstrap starting.
I20260810 18:38:45.309298 31783 tablet_bootstrap.cc:492] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Bootstrap starting.
I20260810 18:38:45.310503 31782 tablet_bootstrap.cc:654] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:45.310956 31784 tablet_bootstrap.cc:492] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Bootstrap starting.
I20260810 18:38:45.312398 31782 log.cc:824] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:45.312950 31783 tablet_bootstrap.cc:654] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:45.314079 31783 log.cc:824] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:45.314266 31784 tablet_bootstrap.cc:654] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:38:45.315604 31784 log.cc:824] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:38:45.315766 31782 tablet_bootstrap.cc:492] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: No bootstrap required, opened a new log
I20260810 18:38:45.316058 31782 ts_tablet_manager.cc:1397] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260810 18:38:45.317507 31783 tablet_bootstrap.cc:492] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: No bootstrap required, opened a new log
I20260810 18:38:45.317759 31783 ts_tablet_manager.cc:1397] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:38:45.321564 31784 tablet_bootstrap.cc:492] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: No bootstrap required, opened a new log
I20260810 18:38:45.321831 31784 ts_tablet_manager.cc:1397] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260810 18:38:45.327858 31782 raft_consensus.cc:348] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.328359 31782 raft_consensus.cc:374] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:45.328490 31782 raft_consensus.cc:729] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69dabe2e916e42adb4a757f51af9b32f, State: Initialized, Role: FOLLOWER
I20260810 18:38:45.328474 31783 raft_consensus.cc:348] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.328897 31783 raft_consensus.cc:374] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:45.328989 31783 raft_consensus.cc:729] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5fa59ef678e440489df745d357caaa4, State: Initialized, Role: FOLLOWER
I20260810 18:38:45.329183 31782 consensus_queue.cc:260] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.329632 31783 consensus_queue.cc:260] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.329598 31784 raft_consensus.cc:348] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.330030 31784 raft_consensus.cc:374] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:38:45.330147 31784 raft_consensus.cc:729] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3666ad3314418bac2d8a50d5f6f2d8, State: Initialized, Role: FOLLOWER
I20260810 18:38:45.330575 31759 heartbeater.cc:503] Master 127.13.139.62:46635 was elected leader, sending a full tablet report...
I20260810 18:38:45.330826 31784 consensus_queue.cc:260] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.331288 31782 ts_tablet_manager.cc:1428] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260810 18:38:45.332254 31610 heartbeater.cc:503] Master 127.13.139.62:46635 was elected leader, sending a full tablet report...
I20260810 18:38:45.332887 31783 ts_tablet_manager.cc:1428] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260810 18:38:45.336792 31784 ts_tablet_manager.cc:1428] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Time spent starting tablet: real 0.015s user 0.010s sys 0.005s
I20260810 18:38:45.358038 31790 raft_consensus.cc:482] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:38:45.358315 31790 raft_consensus.cc:504] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.360049 31790 leader_election.cc:288] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
I20260810 18:38:45.366423 31781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.360446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:47899 (local address 127.13.139.3:40757)
0810 18:38:45.360693 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.360700 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.361089 (+ 389us) server_negotiation.cc:407] Connection header received
0810 18:38:45.361318 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.361327 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.361383 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.361484 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:45.362032 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.362801 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.364661 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.365499 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.365680 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.365757 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.366081 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.366203 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 18:38:45.366720 31779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.360673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:51367 (local address 127.13.139.2:43145)
0810 18:38:45.360880 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.360886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.361426 (+ 540us) server_negotiation.cc:407] Connection header received
0810 18:38:45.361630 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.361634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.361693 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.361790 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:38:45.362391 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.363074 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.364888 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.365732 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.365902 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.366003 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.366324 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.366455 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:38:45.366873 31792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.360281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:43145 (local address 127.13.139.1:51367)
0810 18:38:45.361312 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.361327 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:45.361476 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:45.361816 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:45.361820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:45.361887 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:45.362232 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.362240 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.363224 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.363229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.364715 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.364727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.365975 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.365982 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.366143 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.366166 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 18:38:45.366269 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 18:38:45.366405 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"mutex_wait_us":434,"thread_start_us":319,"threads_started":1}
I20260810 18:38:45.367205 31791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.360281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:40757 (local address 127.13.139.1:47899)
0810 18:38:45.360983 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.360998 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:38:45.361173 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:38:45.361502 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:38:45.361507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:38:45.361533 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:38:45.361885 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.361894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.362939 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.362944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.364510 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:38:45.364522 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.365707 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.365714 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:38:45.365864 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.365890 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 18:38:45.366625 (+ 735us) client_negotiation.cc:240] Negotiation successful
0810 18:38:45.366759 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"mutex_wait_us":21,"thread_start_us":320,"threads_started":1}
I20260810 18:38:45.368088 31562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db3b0a8809b47ed9e18eeac936e7001" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5fa59ef678e440489df745d357caaa4" is_pre_election: true
I20260810 18:38:45.368141 31708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db3b0a8809b47ed9e18eeac936e7001" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69dabe2e916e42adb4a757f51af9b32f" is_pre_election: true
I20260810 18:38:45.368654 31708 raft_consensus.cc:2454] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 0.
I20260810 18:38:45.368654 31562 raft_consensus.cc:2454] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 0.
I20260810 18:38:45.369416 31335 leader_election.cc:302] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8, 69dabe2e916e42adb4a757f51af9b32f; no voters:
I20260810 18:38:45.369802 31790 raft_consensus.cc:2781] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:38:45.369961 31790 raft_consensus.cc:482] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:38:45.370057 31790 raft_consensus.cc:3037] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:45.372273 31790 raft_consensus.cc:504] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.372836 31790 leader_election.cc:288] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 election: Requested vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
W20260810 18:38:45.373008 31460 tablet.cc:2369] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:38:45.373268 31562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db3b0a8809b47ed9e18eeac936e7001" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5fa59ef678e440489df745d357caaa4"
I20260810 18:38:45.373421 31562 raft_consensus.cc:3037] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:45.373389 31708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db3b0a8809b47ed9e18eeac936e7001" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69dabe2e916e42adb4a757f51af9b32f"
I20260810 18:38:45.373618 31708 raft_consensus.cc:3037] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:38:45.375820 31562 raft_consensus.cc:2454] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 1.
I20260810 18:38:45.376138 31708 raft_consensus.cc:2454] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 1.
I20260810 18:38:45.376269 31332 leader_election.cc:302] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8, a5fa59ef678e440489df745d357caaa4; no voters:
I20260810 18:38:45.376572 31790 raft_consensus.cc:2781] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:38:45.377018 31790 raft_consensus.cc:686] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3f3666ad3314418bac2d8a50d5f6f2d8, State: Running, Role: LEADER
I20260810 18:38:45.377452 31790 consensus_queue.cc:237] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } }
I20260810 18:38:45.381739 31245 catalog_manager.cc:5495] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f3666ad3314418bac2d8a50d5f6f2d8 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } health_report { overall_health: UNKNOWN } } }
W20260810 18:38:45.409859 31611 tablet.cc:2369] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:38:45.413141 31780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.407446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53220 (local address 127.13.139.1:43311)
0810 18:38:45.407663 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.407669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.407689 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:38:45.407955 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.407959 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.408060 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.408214 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:38:45.408614 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.409499 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.411005 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.411473 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.411613 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.412093 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:38:45.412567 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:38:45.412728 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.412794 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.412873 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:38:45.420931 31708 raft_consensus.cc:1261] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Refusing update from remote peer 3f3666ad3314418bac2d8a50d5f6f2d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:45.420935 31562 raft_consensus.cc:1261] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Refusing update from remote peer 3f3666ad3314418bac2d8a50d5f6f2d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:38:45.421877 31793 consensus_queue.cc:1035] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:45.422247 31790 consensus_queue.cc:1035] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:38:45.436568 31799 mvcc.cc:205] Tried to move back new op lower bound from 7317041665714446336 to 7317041665549565952. Current Snapshot: MvccSnapshot[applied={T|T < 7317041665714446336}]
I20260810 18:38:45.448477 31245 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36350:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:45.448768 31245 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36350:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:38:45.452587 31245 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Sending DeleteTablet for 3 replicas of tablet 3db3b0a8809b47ed9e18eeac936e7001
I20260810 18:38:45.453744 31388 tablet_service.cc:1514] Processing DeleteTablet for tablet 3db3b0a8809b47ed9e18eeac936e7001 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:45 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:53216
I20260810 18:38:45.453812 31539 tablet_service.cc:1514] Processing DeleteTablet for tablet 3db3b0a8809b47ed9e18eeac936e7001 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:45 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:40200
I20260810 18:38:45.454221 31687 tablet_service.cc:1514] Processing DeleteTablet for tablet 3db3b0a8809b47ed9e18eeac936e7001 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:38:45 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:55238
I20260810 18:38:45.457162 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 31313
I20260810 18:38:45.481025 31811 tablet_replica.cc:330] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: stopping tablet replica
I20260810 18:38:45.481694 31811 raft_consensus.cc:2229] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:45.482398 31811 raft_consensus.cc:2258] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:45.487221 31810 tablet_replica.cc:330] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: stopping tablet replica
I20260810 18:38:45.487685 31810 raft_consensus.cc:2229] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:38:45.488155 31810 raft_consensus.cc:2258] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:38:45.490808 31810 ts_tablet_manager.cc:1905] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:45.491729 31811 ts_tablet_manager.cc:1905] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:45.494010 31809 tablet_replica.cc:330] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: stopping tablet replica
I20260810 18:38:45.494426 31809 raft_consensus.cc:2229] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:38:45.495085 31809 raft_consensus.cc:2258] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 10 18:38:45 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:38:45.499348 31811 ts_tablet_manager.cc:1918] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:45.499558 31811 log.cc:1196] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/3db3b0a8809b47ed9e18eeac936e7001
I20260810 18:38:45.500105 31811 ts_tablet_manager.cc:1939] T 3db3b0a8809b47ed9e18eeac936e7001 P 69dabe2e916e42adb4a757f51af9b32f: Deleting consensus metadata
I20260810 18:38:45.500144 31809 ts_tablet_manager.cc:1905] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:38:45.502421 31226 catalog_manager.cc:4841] TS 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757): tablet 3db3b0a8809b47ed9e18eeac936e7001 (table test-table [id=eef95ddab75b4e11a8a31e1d97ca42d7]) successfully deleted
I20260810 18:38:45.507507 31810 ts_tablet_manager.cc:1918] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:38:45.507694 31810 log.cc:1196] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/3db3b0a8809b47ed9e18eeac936e7001
I20260810 18:38:45.508265 31810 ts_tablet_manager.cc:1939] T 3db3b0a8809b47ed9e18eeac936e7001 P a5fa59ef678e440489df745d357caaa4: Deleting consensus metadata
I20260810 18:38:45.510200 31224 catalog_manager.cc:4841] TS a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145): tablet 3db3b0a8809b47ed9e18eeac936e7001 (table test-table [id=eef95ddab75b4e11a8a31e1d97ca42d7]) successfully deleted
I20260810 18:38:45.512135 31780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.458634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53236 (local address 127.13.139.1:43311)
0810 18:38:45.458825 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.458834 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.477873 (+ 19039us) server_negotiation.cc:407] Connection header received
0810 18:38:45.478516 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.478526 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.478651 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.478745 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:45.484807 (+ 6062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.486556 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.491047 (+ 4491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.491849 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.491964 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.504065 (+ 12101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:45.504081 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:45.504100 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:45.504153 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:45.508479 (+ 4326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.509444 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.509453 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.509458 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.509635 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.510094 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.510099 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.510103 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.510613 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:45.510888 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.511513 (+ 625us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.511773 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 18:38:45.513679 31454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:45.613021 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 31313
I20260810 18:38:45.635253 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 31465
W20260810 18:38:45.635233 31228 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:43311 (error 108)
I20260810 18:38:45.637348 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.636816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53242)
0810 18:38:45.637017 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.637142 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260810 18:38:45.637579 31228 catalog_manager.cc:4584] TS 3f3666ad3314418bac2d8a50d5f6f2d8 (127.13.139.1:43311): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3db3b0a8809b47ed9e18eeac936e7001: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Aug 10 18:38:45 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:38:45.650847 31779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.636111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40214 (local address 127.13.139.2:43145)
0810 18:38:45.636309 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.636313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.636532 (+ 219us) server_negotiation.cc:407] Connection header received
0810 18:38:45.636752 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.636758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.636841 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.636957 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:45.638575 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.639273 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.640710 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.641233 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.641326 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.645704 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:45.645716 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:45.645730 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:45.645765 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:45.648564 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.649211 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.649217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.649219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.649339 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.649653 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.649656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.649658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.650021 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:45.650240 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.650454 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.650605 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:38:45.651608 31605 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:45.691342 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.690860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53256)
0810 18:38:45.691078 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.691185 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 18:38:45.692476 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.692104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53258)
0810 18:38:45.692264 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.692347 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 18:38:45.741364 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 31465
I20260810 18:38:45.753789 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.753188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53266)
0810 18:38:45.753442 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.753570 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260810 18:38:45.754967 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.754478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53268)
0810 18:38:45.754672 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.754787 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 18:38:45.762094 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 31616
Aug 10 18:38:45 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:38:45.777019 31781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.762879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55254 (local address 127.13.139.3:40757)
0810 18:38:45.763083 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 18:38:45.763088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:38:45.763107 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:38:45.763189 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:38:45.763193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:38:45.763255 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:38:45.763337 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:38:45.764752 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.765513 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.766905 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:38:45.767296 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:38:45.767388 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:38:45.771915 (+ 4527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:38:45.771937 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:38:45.771954 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:38:45.771989 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:38:45.774609 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.775275 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.775282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.775284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.775415 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:38:45.775792 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:38:45.775795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:38:45.775797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:38:45.776131 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:38:45.776347 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 18:38:45.776595 (+ 248us) server_negotiation.cc:299] Negotiation successful
0810 18:38:45.776762 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260810 18:38:45.777716 31753 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:45.835599 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.834983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53270)
0810 18:38:45.835256 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.835373 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260810 18:38:45.836724 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:38:45.836278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:53274)
0810 18:38:45.836503 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 18:38:45.836587 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260810 18:38:45.869292 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 31616
I20260810 18:38:45.888476 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 31206
I20260810 18:38:45.889617 31279 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:38:46.004949 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 31206
I20260810 18:39:06.030570 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46635
--webserver_interface=127.13.139.62
--webserver_port=39037
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:46635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:06.369616 31819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:06.369966 31819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:06.370134 31819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:06.377439 31819 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 18:39:06.377568 31819 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 18:39:06.377681 31819 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 18:39:06.377782 31819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:39:06.377893 31819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:06.378017 31819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:06.378111 31819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:39:06.378193 31819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:39:06.388038 31819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:46635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:06.389357 31819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:06.390688 31819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:06.416208 31825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:06.416208 31828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:06.416234 31826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:06.417503 31819 server_base.cc:1034] running on GCE node
I20260810 18:39:06.418576 31819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:06.420230 31819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:06.421545 31819 hybrid_clock.cc:648] HybridClock initialized: now 1786387146421468 us; error 52 us; skew 500 ppm
I20260810 18:39:06.422008 31819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:06 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387146, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:06.426240 31819 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:39:06.428041 31819 webserver.cc:460] Webserver started at http://127.13.139.62:39037/ using document root <none> and password file <none>
I20260810 18:39:06.429239 31819 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:06.429416 31819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:06.435542 31819 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 18:39:06.438485 31838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:06.439953 31819 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:06.440141 31819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "d12dea8182324a9eb0efe8e528a524be"
format_stamp: "Formatted at 2026-08-10 18:38:43 on dist-test-slave-5k54"
server_key: "727a2632436061cf515c4ecd13996190"
server_key_iv: "db1dbbc6c029a635514ddbfb473445f5"
server_key_version: "encryptionkey@0"
I20260810 18:39:06.441231 31819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:06.461841 31819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:06.466522 31819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:06.466856 31819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:06.485500 31819 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:46635
I20260810 18:39:06.485532 31897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:46635 every 8 connection(s)
I20260810 18:39:06.487017 31819 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:39:06.489913 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 31819
I20260810 18:39:06.490710 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:43311
--local_ip_for_outbound_sockets=127.13.139.1
--tserver_master_addrs=127.13.139.62:46635
--webserver_port=46329
--webserver_interface=127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:39:06.494395 31898 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:39:06.497737 31898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Bootstrap starting.
I20260810 18:39:06.517802 31898 log.cc:824] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:06.530319 31898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:39:06.530877 31898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Bootstrap complete.
I20260810 18:39:06.540251 31898 raft_consensus.cc:348] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:06.541080 31898 raft_consensus.cc:729] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d12dea8182324a9eb0efe8e528a524be, State: Initialized, Role: FOLLOWER
I20260810 18:39:06.541807 31898 consensus_queue.cc:260] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:06.542064 31898 raft_consensus.cc:388] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:39:06.542188 31898 raft_consensus.cc:482] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:39:06.542388 31898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 1 FOLLOWER]: Advancing to term 2
I20260810 18:39:06.546638 31898 raft_consensus.cc:504] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:06.547155 31898 leader_election.cc:302] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d12dea8182324a9eb0efe8e528a524be; no voters:
I20260810 18:39:06.547853 31898 leader_election.cc:288] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 18:39:06.547987 31902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 FOLLOWER]: Leader election won for term 2
I20260810 18:39:06.550413 31898 sys_catalog.cc:564] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:39:06.555207 31902 raft_consensus.cc:686] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 LEADER]: Becoming Leader. State: Replica: d12dea8182324a9eb0efe8e528a524be, State: Running, Role: LEADER
I20260810 18:39:06.555757 31902 consensus_queue.cc:237] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:06.558235 31904 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: SysCatalogTable state changed. Reason: New leader d12dea8182324a9eb0efe8e528a524be. Latest consensus state: current_term: 2 leader_uuid: "d12dea8182324a9eb0efe8e528a524be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } } }
I20260810 18:39:06.558229 31903 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d12dea8182324a9eb0efe8e528a524be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } } }
I20260810 18:39:06.558672 31904 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:06.558668 31903 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:06.567713 31913 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:39:06.575491 31913 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:39:06.576923 31913 catalog_manager.cc:1259] Loaded cluster ID: 35dceb4013544055b0dfad955108881b
I20260810 18:39:06.577035 31913 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:39:06.581009 31913 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:39:06.582499 31913 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Loaded TSK: 0
I20260810 18:39:06.617475 31913 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Generated new TSK 1
I20260810 18:39:06.617949 31913 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 18:39:06.850243 31900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:06.850625 31900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:06.850808 31900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:06.858421 31900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:06.858569 31900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:06.858759 31900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:39:06.868552 31900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:43311
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=46329
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:06.870357 31900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:06.872211 31900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:06.890865 31927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:06.891755 31926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:06.892155 31929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:06.892534 31900 server_base.cc:1034] running on GCE node
I20260810 18:39:06.893195 31900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:06.894246 31900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:06.895522 31900 hybrid_clock.cc:648] HybridClock initialized: now 1786387146895460 us; error 58 us; skew 500 ppm
I20260810 18:39:06.895892 31900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:06 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387146, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:06.899571 31900 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:39:06.901257 31900 webserver.cc:460] Webserver started at http://127.13.139.1:46329/ using document root <none> and password file <none>
I20260810 18:39:06.901993 31900 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:06.902149 31900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:06.907791 31900 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 18:39:06.910905 31939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:06.912425 31900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:06.912586 31900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "3f3666ad3314418bac2d8a50d5f6f2d8"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "6fad8bc63c9b64895ef45b4a4ac32139"
server_key_iv: "4f75057c79c06a96c5598aaf1eb89220"
server_key_version: "encryptionkey@0"
I20260810 18:39:06.913543 31900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:06.932528 31900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:06.937476 31900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:06.937767 31900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:06.938928 31900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:06.941108 31947 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260810 18:39:06.946898 31947 ts_tablet_manager.cc:1852] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260810 18:39:06.947979 31947 ts_tablet_manager.cc:1905] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:06.955780 31947 ts_tablet_manager.cc:1918] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:06.956007 31947 log.cc:1196] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/3db3b0a8809b47ed9e18eeac936e7001
I20260810 18:39:06.956483 31947 ts_tablet_manager.cc:1939] T 3db3b0a8809b47ed9e18eeac936e7001 P 3f3666ad3314418bac2d8a50d5f6f2d8: Deleting consensus metadata
I20260810 18:39:06.956908 31900 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260810 18:39:06.957039 31900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.001s sys 0.000s
I20260810 18:39:06.957185 31900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:06.957278 31900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:06.999603 31900 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:43311
I20260810 18:39:06.999696 32062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:43311 every 8 connection(s)
I20260810 18:39:07.000996 31900 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:39:07.011570 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 31900
I20260810 18:39:07.012228 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:43145
--local_ip_for_outbound_sockets=127.13.139.2
--tserver_master_addrs=127.13.139.62:46635
--webserver_port=40821
--webserver_interface=127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:39:07 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387146, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:07.026198 32066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:07.004144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:33253)
0810 18:39:07.005091 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:07.005145 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:07.006988 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:07.008375 (+ 1387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:07.008382 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:07.008934 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:07.009481 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:07.009497 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.011298 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.011303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:07.012811 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:07.012831 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.014344 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.014349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:07.014539 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:07.015242 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:07.015264 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:07.018068 (+ 2804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:07.021652 (+ 3584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:07.021664 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:07.021681 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:07.022318 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:07.022745 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:07.022752 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:07.022758 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:07.022987 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:07.023781 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:07.023789 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:07.024111 (+ 322us) client_negotiation.cc:769] Sending connection context
0810 18:39:07.024371 (+ 260us) client_negotiation.cc:240] Negotiation successful
0810 18:39:07.024908 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":396,"threads_started":1}
I20260810 18:39:07.026201 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:07.003896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:33253 (local address 127.13.139.62:46635)
0810 18:39:07.004522 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:07.004534 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:07.005317 (+ 783us) server_negotiation.cc:407] Connection header received
0810 18:39:07.007583 (+ 2266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:07.007596 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:07.007942 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:07.008245 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:07.009699 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.011115 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.012964 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.014109 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.014319 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:07.018387 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:07.018395 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:07.018423 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:07.018462 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:07.021502 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.022465 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.022471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.022476 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.022637 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.023098 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.023101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.023103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.023630 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:07.023843 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:07.024627 (+ 784us) server_negotiation.cc:299] Negotiation successful
0810 18:39:07.025013 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":281,"threads_started":1}
I20260810 18:39:07.029076 32063 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46635
I20260810 18:39:07.029395 32063 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:07.030055 32063 heartbeater.cc:511] Master 127.13.139.62:46635 requested a full tablet report, sending...
I20260810 18:39:07.032480 31860 ts_manager.cc:194] Registered new tserver with Master: 3f3666ad3314418bac2d8a50d5f6f2d8 (127.13.139.1:43311)
I20260810 18:39:07.033923 31860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:33253
W20260810 18:39:07.349813 32067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:07.350133 32067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:07.350303 32067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:07.357728 32067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:07.357887 32067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:07.358060 32067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:39:07.367709 32067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:43145
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=40821
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:07.368984 32067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:07.370299 32067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:07.383277 32074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:07.383316 32077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:07.383368 32073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:07.384469 32067 server_base.cc:1034] running on GCE node
I20260810 18:39:07.385092 32067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:07.386019 32067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:07.387248 32067 hybrid_clock.cc:648] HybridClock initialized: now 1786387147387203 us; error 58 us; skew 500 ppm
I20260810 18:39:07.387609 32067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:07 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387147, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:07.390714 32067 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:39:07.392200 32067 webserver.cc:460] Webserver started at http://127.13.139.2:40821/ using document root <none> and password file <none>
I20260810 18:39:07.392828 32067 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:07.393007 32067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:07.398195 32067 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260810 18:39:07.400852 32085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:07.402174 32067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:07.402359 32067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "a5fa59ef678e440489df745d357caaa4"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "eb5e28ac65462818431c0a5c2ede635f"
server_key_iv: "faf23b6785f76a44bdbd3a8f9f5dc144"
server_key_version: "encryptionkey@0"
I20260810 18:39:07.403429 32067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:07.463500 32067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:07.467612 32067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:07.467895 32067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:07.468928 32067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:07.470254 32067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:07.470381 32067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:07.470515 32067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:07.470614 32067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:07.506721 32067 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:43145
I20260810 18:39:07.506816 32222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:43145 every 8 connection(s)
I20260810 18:39:07.508227 32067 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:39:07.515190 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 32067
I20260810 18:39:07.515898 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:40757
--local_ip_for_outbound_sockets=127.13.139.3
--tserver_master_addrs=127.13.139.62:46635
--webserver_port=35539
--webserver_interface=127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 18:39:07 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387147, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:07.528182 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:07.510741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:42593 (local address 127.13.139.62:46635)
0810 18:39:07.510969 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:07.510973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:07.512125 (+ 1152us) server_negotiation.cc:407] Connection header received
0810 18:39:07.513952 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:07.513959 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:07.514086 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:07.514202 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:07.515782 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.516587 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.518262 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.518706 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.518845 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:07.522280 (+ 3435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:07.522290 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:07.522294 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:07.522327 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:07.525095 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.525839 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.525844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.525850 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.525984 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.526440 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.526443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.526445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.526710 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:07.526869 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:07.527564 (+ 695us) server_negotiation.cc:299] Negotiation successful
0810 18:39:07.527803 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260810 18:39:07.529129 32225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:07.511174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:42593)
0810 18:39:07.511944 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:07.511989 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:07.513672 (+ 1683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:07.514439 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:07.514447 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:07.514952 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:07.515614 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:07.515633 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.516749 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.516757 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:07.518114 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:07.518126 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.518934 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.518942 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:07.519174 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:07.519900 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:07.519922 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:07.522051 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:07.525245 (+ 3194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:07.525253 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:07.525269 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:07.525704 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:07.526096 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:07.526102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:07.526105 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:07.526299 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:07.526842 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:07.526850 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:07.527183 (+ 333us) client_negotiation.cc:769] Sending connection context
0810 18:39:07.527463 (+ 280us) client_negotiation.cc:240] Negotiation successful
0810 18:39:07.528010 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":317,"threads_started":1}
I20260810 18:39:07.530658 32223 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46635
I20260810 18:39:07.530987 32223 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:07.531926 32223 heartbeater.cc:511] Master 127.13.139.62:46635 requested a full tablet report, sending...
I20260810 18:39:07.533550 31860 ts_manager.cc:194] Registered new tserver with Master: a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145)
I20260810 18:39:07.534351 31860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:42593
W20260810 18:39:07.855204 32226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:07.855572 32226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:07.855753 32226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:07.863051 32226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:07.863155 32226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:07.863269 32226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:39:07.873356 32226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:40757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=35539
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:07.874627 32226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:07.876044 32226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:07.889072 32234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:07.889184 32235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:07.889398 32237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:07.890177 32226 server_base.cc:1034] running on GCE node
I20260810 18:39:07.890782 32226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:07.891876 32226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:07.893095 32226 hybrid_clock.cc:648] HybridClock initialized: now 1786387147893033 us; error 53 us; skew 500 ppm
I20260810 18:39:07.893376 32226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:07 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387147, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:07.896636 32226 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:39:07.898034 32226 webserver.cc:460] Webserver started at http://127.13.139.3:35539/ using document root <none> and password file <none>
I20260810 18:39:07.898713 32226 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:07.898871 32226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:07.904378 32226 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:39:07.907352 32245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:07.908744 32226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:39:07.908949 32226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "69dabe2e916e42adb4a757f51af9b32f"
format_stamp: "Formatted at 2026-08-10 18:38:45 on dist-test-slave-5k54"
server_key: "3d07f496394402e52c4866eaa28a9455"
server_key_iv: "2f73382c82f71b8eafbe95338d8e203e"
server_key_version: "encryptionkey@0"
I20260810 18:39:07.909907 32226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:07.932242 32226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:07.936434 32226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:07.936718 32226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:07.937815 32226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:07.939199 32226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:07.939296 32226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:07.939419 32226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:07.939519 32226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260810 18:39:07.974787 32226 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:40757
I20260810 18:39:07.974926 32364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:40757 every 8 connection(s)
I20260810 18:39:07.976361 32226 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:39:07.978250 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 32226
Aug 10 18:39:07 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387147, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:07.994320 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:07.979630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44144 (local address 127.13.139.62:46635)
0810 18:39:07.980856 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:07.980860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:07.980876 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:39:07.980937 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:07.980940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:07.980998 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:07.981130 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:07.982851 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.983695 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.985086 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.985600 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.985740 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:07.988642 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:07.988647 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:07.988650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:07.988682 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:07.991307 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.992007 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.992014 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.992018 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.992184 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.992678 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.992684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.992695 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.993021 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:07.993334 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:07.993639 (+ 305us) server_negotiation.cc:299] Negotiation successful
0810 18:39:07.993866 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1138,"thread_start_us":1039,"threads_started":1}
I20260810 18:39:07.998492 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:07.979019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:57323 (local address 127.13.139.62:46635)
0810 18:39:07.979235 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:07.979239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:07.981521 (+ 2282us) server_negotiation.cc:407] Connection header received
0810 18:39:07.983455 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:07.983461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:07.983542 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:07.983671 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:07.985148 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.986023 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.987824 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.988242 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.988372 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:07.991985 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:07.991990 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:07.991993 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:07.992022 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:07.995331 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.996173 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.996177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.996179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.996300 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:07.996795 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:07.996800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:07.996803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:07.997053 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:07.997209 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:07.997908 (+ 699us) server_negotiation.cc:299] Negotiation successful
0810 18:39:07.998131 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":97}
I20260810 18:39:08.000329 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:07.979659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:57323)
0810 18:39:07.981341 (+ 1682us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:07.981399 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:07.983166 (+ 1767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:07.983912 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:07.983921 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:07.984416 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:07.984978 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:07.984996 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.986186 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.986193 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:07.987675 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:07.987688 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:07.988502 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:07.988511 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:07.988735 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:07.989376 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:07.989429 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:07.991769 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:07.995487 (+ 3718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:07.995497 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:07.995512 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:07.996047 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:07.996420 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:07.996424 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:07.996428 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:07.996683 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:07.997188 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:07.997196 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:07.997536 (+ 340us) client_negotiation.cc:769] Sending connection context
0810 18:39:07.997797 (+ 261us) client_negotiation.cc:240] Negotiation successful
0810 18:39:07.998332 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1386,"thread_start_us":1170,"threads_started":1}
I20260810 18:39:08.001847 32365 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46635
I20260810 18:39:08.002138 32365 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:08.002794 32365 heartbeater.cc:511] Master 127.13.139.62:46635 requested a full tablet report, sending...
I20260810 18:39:08.004434 31860 ts_manager.cc:194] Registered new tserver with Master: 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
I20260810 18:39:08.005282 31860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:57323
I20260810 18:39:08.009435 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:39:08.016080 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.010329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44150 (local address 127.13.139.62:46635)
0810 18:39:08.010502 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.010506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.011055 (+ 549us) server_negotiation.cc:407] Connection header received
0810 18:39:08.011239 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.011242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.011362 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.011541 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:39:08.011949 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.012679 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.014246 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.014718 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.014808 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.015296 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:39:08.015610 (+ 314us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 18:39:08.015891 (+ 281us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44150: token expired
Metrics: {"server-negotiator.queue_time_us":73}
W20260810 18:39:08.016213 32065 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44150: token expired
W20260810 18:39:08.016788 31764 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.13.139.62:46635)
I20260810 18:39:08.029263 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.017298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44156 (local address 127.13.139.62:46635)
0810 18:39:08.017468 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.017472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.017513 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:39:08.017642 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.017645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.017707 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.017782 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:08.019188 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.019958 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.021236 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.021616 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.021704 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.024410 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:08.024415 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:08.024418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:08.024446 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:08.026875 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.027539 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.027543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.027545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.027659 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.028004 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.028007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.028009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.028294 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:08.028475 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.028804 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.029006 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 18:39:08.037211 32063 heartbeater.cc:503] Master 127.13.139.62:46635 was elected leader, sending a full tablet report...
I20260810 18:39:08.032662 31860 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:39:08.040242 31860 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:39:08.079552 32382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.053629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50388 (local address 127.13.139.3:40757)
0810 18:39:08.071078 (+ 17449us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.071091 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.071133 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:39:08.071260 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.071271 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.071673 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.071922 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:08.073182 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.074485 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.077330 (+ 2845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.078274 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.078442 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.078700 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.078992 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.079157 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17223,"thread_start_us":16995,"threads_started":1}
I20260810 18:39:08.079609 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.052884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:40757 (local address 127.0.0.1:50388)
0810 18:39:08.070162 (+ 17278us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.070187 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:08.070334 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:08.072123 (+ 1789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:08.072134 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:08.072170 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:08.072671 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.072686 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.074617 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.074623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.077154 (+ 2531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.077171 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.078502 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.078512 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.078734 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.078786 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 18:39:08.078952 (+ 166us) client_negotiation.cc:240] Negotiation successful
0810 18:39:08.079134 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17093,"mutex_wait_us":1,"thread_start_us":18416,"threads_started":1}
I20260810 18:39:08.080487 32380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.053146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37092)
0810 18:39:08.071634 (+ 18488us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.071655 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:08.071883 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:08.072847 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:08.072851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:08.072875 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:08.073247 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.073260 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.075106 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.075112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.077282 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.077299 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.079502 (+ 2203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.079509 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.079682 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.079719 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 18:39:08.079944 (+ 225us) client_negotiation.cc:240] Negotiation successful
0810 18:39:08.080075 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18328,"mutex_wait_us":34,"thread_start_us":16678,"threads_started":1}
I20260810 18:39:08.081328 32383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.053779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37092 (local address 127.13.139.1:43311)
0810 18:39:08.070870 (+ 17091us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.070884 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.071760 (+ 876us) server_negotiation.cc:407] Connection header received
0810 18:39:08.072130 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.072138 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.072375 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.072540 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:08.073432 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.074959 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.077454 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.078944 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.079080 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.079325 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.080797 (+ 1472us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.080976 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16903,"thread_start_us":17095,"threads_started":1}
I20260810 18:39:08.082741 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.052572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:43145 (local address 127.0.0.1:60046)
0810 18:39:08.067026 (+ 14454us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.067090 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:08.067365 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:08.074375 (+ 7010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:08.074382 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:08.074412 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:08.074812 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.074821 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.076822 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.076829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.079031 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.079046 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.082034 (+ 2988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.082043 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.082216 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.082254 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 18:39:08.082361 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 18:39:08.082490 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14089,"thread_start_us":15104,"threads_started":1}
I20260810 18:39:08.083549 32379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.052769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60046 (local address 127.13.139.2:43145)
0810 18:39:08.073830 (+ 21061us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.073838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.073867 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:39:08.073955 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.073961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.074170 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.074348 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:08.074993 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.076684 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.079208 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.081564 (+ 2356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.081697 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.081876 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.082987 (+ 1111us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.083177 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20870,"thread_start_us":20722,"threads_started":1}
I20260810 18:39:08.083285 31994 tablet_service.cc:1467] Processing CreateTablet for tablet d90c3d0cc54540a496c537997265a318 (DEFAULT_TABLE table=test-table [id=ca200795235d4229bd6ec2ff2d11651c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:08.083983 32298 tablet_service.cc:1467] Processing CreateTablet for tablet d90c3d0cc54540a496c537997265a318 (DEFAULT_TABLE table=test-table [id=ca200795235d4229bd6ec2ff2d11651c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:08.084867 31994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d90c3d0cc54540a496c537997265a318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:08.085398 32298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d90c3d0cc54540a496c537997265a318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:08.090144 32149 tablet_service.cc:1467] Processing CreateTablet for tablet d90c3d0cc54540a496c537997265a318 (DEFAULT_TABLE table=test-table [id=ca200795235d4229bd6ec2ff2d11651c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:08.091447 32149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d90c3d0cc54540a496c537997265a318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:08.095180 32384 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Bootstrap starting.
I20260810 18:39:08.098932 32384 tablet_bootstrap.cc:654] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:08.100214 32384 log.cc:824] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:08.100435 32385 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Bootstrap starting.
I20260810 18:39:08.103617 32385 tablet_bootstrap.cc:654] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:08.104877 32385 log.cc:824] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:08.106489 32384 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: No bootstrap required, opened a new log
I20260810 18:39:08.106868 32384 ts_tablet_manager.cc:1397] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260810 18:39:08.107887 32385 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: No bootstrap required, opened a new log
I20260810 18:39:08.108155 32385 ts_tablet_manager.cc:1397] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 18:39:08.108541 32388 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Bootstrap starting.
I20260810 18:39:08.112160 32388 tablet_bootstrap.cc:654] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:08.113508 32388 log.cc:824] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:08.115373 32384 raft_consensus.cc:348] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.115792 32384 raft_consensus.cc:374] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:08.115887 32384 raft_consensus.cc:729] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3666ad3314418bac2d8a50d5f6f2d8, State: Initialized, Role: FOLLOWER
I20260810 18:39:08.116506 32384 consensus_queue.cc:260] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.116756 32388 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: No bootstrap required, opened a new log
I20260810 18:39:08.118497 32384 ts_tablet_manager.cc:1428] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
I20260810 18:39:08.118526 32388 ts_tablet_manager.cc:1397] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.006s
I20260810 18:39:08.118744 32385 raft_consensus.cc:348] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.119194 32385 raft_consensus.cc:374] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:08.119303 32385 raft_consensus.cc:729] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69dabe2e916e42adb4a757f51af9b32f, State: Initialized, Role: FOLLOWER
I20260810 18:39:08.119937 32385 consensus_queue.cc:260] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.121081 32365 heartbeater.cc:503] Master 127.13.139.62:46635 was elected leader, sending a full tablet report...
I20260810 18:39:08.121660 32385 ts_tablet_manager.cc:1428] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260810 18:39:08.127811 32388 raft_consensus.cc:348] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.128178 32388 raft_consensus.cc:374] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:08.128279 32388 raft_consensus.cc:729] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5fa59ef678e440489df745d357caaa4, State: Initialized, Role: FOLLOWER
I20260810 18:39:08.128868 32388 consensus_queue.cc:260] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.129896 32223 heartbeater.cc:503] Master 127.13.139.62:46635 was elected leader, sending a full tablet report...
I20260810 18:39:08.130541 32388 ts_tablet_manager.cc:1428] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260810 18:39:08.180395 32391 raft_consensus.cc:482] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:08.180742 32391 raft_consensus.cc:504] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.182591 32391 leader_election.cc:288] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
I20260810 18:39:08.189865 32379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.182965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:42765 (local address 127.13.139.2:43145)
0810 18:39:08.183188 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.183194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.184067 (+ 873us) server_negotiation.cc:407] Connection header received
0810 18:39:08.184286 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.184291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.184372 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.184480 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:08.185194 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.185952 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.187992 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.188842 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.188969 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.189023 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.189460 (+ 437us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.189598 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 18:39:08.189931 32394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.182791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:43145 (local address 127.13.139.1:42765)
0810 18:39:08.183914 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.183939 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:08.184123 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:08.184512 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:08.184517 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:08.184543 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:08.185029 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.185042 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.186107 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.186112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.187830 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.187842 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.189079 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.189085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.189271 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.189314 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 18:39:08.189410 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 18:39:08.189520 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":870,"mutex_wait_us":1,"spinlock_wait_cycles":8960,"thread_start_us":634,"threads_started":1}
I20260810 18:39:08.190517 32395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.183071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:40757 (local address 127.13.139.1:57579)
0810 18:39:08.184154 (+ 1083us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.184169 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:08.184324 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:08.184683 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:08.184687 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:08.184731 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:08.185163 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.185175 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.186416 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.186421 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.188053 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:08.188066 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.189350 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.189354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:08.189548 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.189579 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 18:39:08.189675 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 18:39:08.189802 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"spinlock_wait_cycles":2304,"thread_start_us":641,"threads_started":1}
I20260810 18:39:08.190515 32382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.183341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:57579 (local address 127.13.139.3:40757)
0810 18:39:08.183567 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.183573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.184291 (+ 718us) server_negotiation.cc:407] Connection header received
0810 18:39:08.184469 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.184475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.184554 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.184660 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:08.185381 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.186205 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.188219 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.189148 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.189307 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.189382 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.189729 (+ 347us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.189860 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 18:39:08.190985 32171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d90c3d0cc54540a496c537997265a318" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5fa59ef678e440489df745d357caaa4" is_pre_election: true
I20260810 18:39:08.191541 32318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d90c3d0cc54540a496c537997265a318" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69dabe2e916e42adb4a757f51af9b32f" is_pre_election: true
I20260810 18:39:08.191617 32171 raft_consensus.cc:2454] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 0.
I20260810 18:39:08.192013 32318 raft_consensus.cc:2454] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 0.
I20260810 18:39:08.192304 31940 leader_election.cc:302] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8, a5fa59ef678e440489df745d357caaa4; no voters:
I20260810 18:39:08.192759 32391 raft_consensus.cc:2781] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:39:08.192879 32391 raft_consensus.cc:482] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:39:08.193024 32391 raft_consensus.cc:3037] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:08.195259 32391 raft_consensus.cc:504] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.195904 32391 leader_election.cc:288] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 election: Requested vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
I20260810 18:39:08.196321 32171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d90c3d0cc54540a496c537997265a318" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5fa59ef678e440489df745d357caaa4"
I20260810 18:39:08.196412 32318 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d90c3d0cc54540a496c537997265a318" candidate_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69dabe2e916e42adb4a757f51af9b32f"
I20260810 18:39:08.196530 32171 raft_consensus.cc:3037] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:08.196646 32318 raft_consensus.cc:3037] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:08.198848 32171 raft_consensus.cc:2454] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 1.
I20260810 18:39:08.198897 32318 raft_consensus.cc:2454] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f3666ad3314418bac2d8a50d5f6f2d8 in term 1.
I20260810 18:39:08.199285 31943 leader_election.cc:302] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8, 69dabe2e916e42adb4a757f51af9b32f; no voters:
I20260810 18:39:08.199666 32391 raft_consensus.cc:2781] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:08.200150 32391 raft_consensus.cc:686] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3f3666ad3314418bac2d8a50d5f6f2d8, State: Running, Role: LEADER
I20260810 18:39:08.200676 32391 consensus_queue.cc:237] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:08.205227 31858 catalog_manager.cc:5495] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f3666ad3314418bac2d8a50d5f6f2d8 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } health_report { overall_health: HEALTHY } } }
W20260810 18:39:08.228042 32366 tablet.cc:2369] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:39:08.233114 32383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.227551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37108 (local address 127.13.139.1:43311)
0810 18:39:08.227732 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.227736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.227754 (+ 18us) server_negotiation.cc:407] Connection header received
0810 18:39:08.227842 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.227845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.227941 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.228130 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:39:08.228660 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.229496 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.230883 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.231291 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.231389 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.231936 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:39:08.232448 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:39:08.232572 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.232715 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.232782 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 18:39:08.241637 32318 raft_consensus.cc:1261] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Refusing update from remote peer 3f3666ad3314418bac2d8a50d5f6f2d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:39:08.241637 32171 raft_consensus.cc:1261] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Refusing update from remote peer 3f3666ad3314418bac2d8a50d5f6f2d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:39:08.242930 32391 consensus_queue.cc:1035] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:39:08.243254 32396 consensus_queue.cc:1035] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 18:39:08.253351 32064 tablet.cc:2369] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:39:08.260104 32224 tablet.cc:2369] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:39:08.261862 32399 mvcc.cc:205] Tried to move back new op lower bound from 7317041759186247680 to 7317041759033978880. Current Snapshot: MvccSnapshot[applied={T|T < 7317041759186247680 or (T in {7317041759186247680})}]
I20260810 18:39:08.273249 31858 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:08.273528 31858 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:08.276996 31858 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Sending DeleteTablet for 3 replicas of tablet d90c3d0cc54540a496c537997265a318
I20260810 18:39:08.278085 32149 tablet_service.cc:1514] Processing DeleteTablet for tablet d90c3d0cc54540a496c537997265a318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:08 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:60046
I20260810 18:39:08.278244 32298 tablet_service.cc:1514] Processing DeleteTablet for tablet d90c3d0cc54540a496c537997265a318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:08 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:50388
I20260810 18:39:08.278519 31994 tablet_service.cc:1514] Processing DeleteTablet for tablet d90c3d0cc54540a496c537997265a318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:08 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:37092
I20260810 18:39:08.279736 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 31900
I20260810 18:39:08.293465 32413 tablet_replica.cc:330] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: stopping tablet replica
I20260810 18:39:08.294000 32413 raft_consensus.cc:2229] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:08.294654 32413 raft_consensus.cc:2258] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:08.297302 32413 ts_tablet_manager.cc:1905] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:08.300633 32383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.280677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37112 (local address 127.13.139.1:43311)
0810 18:39:08.280856 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.280862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.281068 (+ 206us) server_negotiation.cc:407] Connection header received
0810 18:39:08.281274 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.281279 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.281369 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.281488 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:08.283685 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.284989 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.287562 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.288262 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.288391 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.292842 (+ 4451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:08.292859 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:08.292892 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:08.292936 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:08.297322 (+ 4386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.298240 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.298248 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.298252 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.298501 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.298894 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.298900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.298903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.299382 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:08.299701 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.300007 (+ 306us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.300255 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 18:39:08.301553 32058 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:08.303679 32414 tablet_replica.cc:330] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: stopping tablet replica
I20260810 18:39:08.304243 32414 raft_consensus.cc:2229] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:08.304886 32414 raft_consensus.cc:2258] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:08.305950 32413 ts_tablet_manager.cc:1918] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:08.306160 32413 log.cc:1196] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/d90c3d0cc54540a496c537997265a318
I20260810 18:39:08.306979 32413 ts_tablet_manager.cc:1939] T d90c3d0cc54540a496c537997265a318 P a5fa59ef678e440489df745d357caaa4: Deleting consensus metadata
I20260810 18:39:08.307665 32414 ts_tablet_manager.cc:1905] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:08.309571 31839 catalog_manager.cc:4841] TS a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145): tablet d90c3d0cc54540a496c537997265a318 (table test-table [id=ca200795235d4229bd6ec2ff2d11651c]) successfully deleted
I20260810 18:39:08.315626 32414 ts_tablet_manager.cc:1918] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:08.315811 32414 log.cc:1196] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/d90c3d0cc54540a496c537997265a318
I20260810 18:39:08.316375 32414 ts_tablet_manager.cc:1939] T d90c3d0cc54540a496c537997265a318 P 69dabe2e916e42adb4a757f51af9b32f: Deleting consensus metadata
I20260810 18:39:08.318368 31841 catalog_manager.cc:4841] TS 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757): tablet d90c3d0cc54540a496c537997265a318 (table test-table [id=ca200795235d4229bd6ec2ff2d11651c]) successfully deleted
I20260810 18:39:08.407253 32415 tablet_replica.cc:330] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: stopping tablet replica
I20260810 18:39:08.407577 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 31900
W20260810 18:39:08.430043 31842 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:43311 (error 108)
I20260810 18:39:08.430394 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 32067
I20260810 18:39:08.432266 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.431860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37118)
0810 18:39:08.432031 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.432124 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260810 18:39:08.432482 31842 catalog_manager.cc:4584] TS 3f3666ad3314418bac2d8a50d5f6f2d8 (127.13.139.1:43311): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d90c3d0cc54540a496c537997265a318: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
I20260810 18:39:08.445981 32379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.431356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60054 (local address 127.13.139.2:43145)
0810 18:39:08.431571 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.431580 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.431600 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:39:08.431838 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.431843 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.431923 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.432044 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:08.433608 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.434396 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.436046 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.436463 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.436603 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.439489 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:08.439512 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:08.439528 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:08.439562 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:08.442486 (+ 2924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.443338 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.443349 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.443352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.443568 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.443978 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.443984 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.443987 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.444478 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:08.444805 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.445320 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.445570 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260810 18:39:08.446785 32218 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:08.486478 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.485929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37126)
0810 18:39:08.486157 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.486287 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 18:39:08.487664 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.487229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37130)
0810 18:39:08.487390 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.487503 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 18:39:08.537302 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 32067
I20260810 18:39:08.548370 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.547783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37140)
0810 18:39:08.548032 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.548158 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 18:39:08.549539 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.549096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37144)
0810 18:39:08.549272 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.549368 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 18:39:08.558776 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 32226
I20260810 18:39:08.573266 32382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.559662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50390 (local address 127.13.139.3:40757)
0810 18:39:08.559849 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:08.559857 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:08.559896 (+ 39us) server_negotiation.cc:407] Connection header received
0810 18:39:08.560110 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:08.560122 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:08.560206 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:08.560312 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:08.561888 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.562611 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.564096 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:08.564524 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:08.564676 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:08.567551 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:08.567567 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:08.567583 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:08.567616 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:08.570223 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.570992 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.571000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.571002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.571154 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:08.571631 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:08.571637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:08.571640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:08.572001 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:08.572321 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:08.572681 (+ 360us) server_negotiation.cc:299] Negotiation successful
0810 18:39:08.572924 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:39:08.573933 32360 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:08.630832 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.630282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37158)
0810 18:39:08.630549 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.630656 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260810 18:39:08.632011 32378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:08.631612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43311 (local address 127.0.0.1:37164)
0810 18:39:08.631803 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:08.631908 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:43311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260810 18:39:08.664502 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 32226
I20260810 18:39:08.685113 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 31819
I20260810 18:39:08.686364 31893 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:08.804003 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 31819
I20260810 18:39:28.827960 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46635
--webserver_interface=127.13.139.62
--webserver_port=39037
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:46635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:29.175319 32421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:29.175674 32421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:29.175859 32421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:29.183280 32421 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 18:39:29.183374 32421 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 18:39:29.183455 32421 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 18:39:29.183557 32421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:39:29.183627 32421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:29.183727 32421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:29.183810 32421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:39:29.183887 32421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:39:29.194319 32421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:46635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:29.195654 32421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:29.197031 32421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:29.209367 32428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:29.209455 32429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:29.209422 32431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:29.210259 32421 server_base.cc:1034] running on GCE node
I20260810 18:39:29.210983 32421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:29.212422 32421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:29.213644 32421 hybrid_clock.cc:648] HybridClock initialized: now 1786387169213577 us; error 31 us; skew 500 ppm
I20260810 18:39:29.213981 32421 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:29 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387169, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:29.217304 32421 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:39:29.218780 32421 webserver.cc:460] Webserver started at http://127.13.139.62:39037/ using document root <none> and password file <none>
I20260810 18:39:29.219550 32421 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:29.219662 32421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:29.225015 32421 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:39:29.227833 32438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:29.229271 32421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:29.229409 32421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "d12dea8182324a9eb0efe8e528a524be"
format_stamp: "Formatted at 2026-08-10 18:38:43 on dist-test-slave-5k54"
server_key: "727a2632436061cf515c4ecd13996190"
server_key_iv: "db1dbbc6c029a635514ddbfb473445f5"
server_key_version: "encryptionkey@0"
I20260810 18:39:29.230321 32421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:29.270747 32421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:29.275100 32421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:29.275342 32421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:29.294389 32421 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:46635
I20260810 18:39:29.294477 32500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:46635 every 8 connection(s)
I20260810 18:39:29.295930 32421 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:39:29.298933 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 32421
I20260810 18:39:29.299849 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:43311
--local_ip_for_outbound_sockets=127.13.139.1
--tserver_master_addrs=127.13.139.62:46635
--webserver_port=46329
--webserver_interface=127.13.139.1
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:39:29.303109 32501 sys_catalog.cc:263] Verifying existing consensus state
I20260810 18:39:29.307471 32501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Bootstrap starting.
I20260810 18:39:29.328684 32501 log.cc:824] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:29.351716 32501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:39:29.352460 32501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Bootstrap complete.
I20260810 18:39:29.366753 32501 raft_consensus.cc:348] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:29.368388 32501 raft_consensus.cc:729] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d12dea8182324a9eb0efe8e528a524be, State: Initialized, Role: FOLLOWER
I20260810 18:39:29.369246 32501 consensus_queue.cc:260] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:29.369607 32501 raft_consensus.cc:388] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:39:29.369771 32501 raft_consensus.cc:482] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:39:29.370004 32501 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 2 FOLLOWER]: Advancing to term 3
I20260810 18:39:29.376080 32501 raft_consensus.cc:504] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:29.376677 32501 leader_election.cc:302] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d12dea8182324a9eb0efe8e528a524be; no voters:
I20260810 18:39:29.377374 32501 leader_election.cc:288] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 18:39:29.377579 32505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 3 FOLLOWER]: Leader election won for term 3
I20260810 18:39:29.378938 32505 raft_consensus.cc:686] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [term 3 LEADER]: Becoming Leader. State: Replica: d12dea8182324a9eb0efe8e528a524be, State: Running, Role: LEADER
I20260810 18:39:29.379586 32501 sys_catalog.cc:564] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:39:29.379555 32505 consensus_queue.cc:237] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } }
I20260810 18:39:29.381997 32508 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: SysCatalogTable state changed. Reason: New leader d12dea8182324a9eb0efe8e528a524be. Latest consensus state: current_term: 3 leader_uuid: "d12dea8182324a9eb0efe8e528a524be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } } }
I20260810 18:39:29.382365 32508 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:29.382891 32507 sys_catalog.cc:455] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d12dea8182324a9eb0efe8e528a524be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d12dea8182324a9eb0efe8e528a524be" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46635 } } }
I20260810 18:39:29.383180 32507 sys_catalog.cc:458] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:29.387485 32514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:39:29.396137 32514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:39:29.397631 32514 catalog_manager.cc:1259] Loaded cluster ID: 35dceb4013544055b0dfad955108881b
I20260810 18:39:29.397734 32514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:39:29.401789 32514 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:39:29.403589 32514 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Loaded TSK: 0
I20260810 18:39:29.403726 32514 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d12dea8182324a9eb0efe8e528a524be: Loaded TSK: 1
F20260810 18:39:29.404837 32514 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff3bbbc99ad google::LogMessage::Fail() at ??:0
@ 0x7ff3bbbcc88a google::LogMessage::SendToLog() at ??:0
@ 0x7ff3bbbc94de google::LogMessage::Flush() at ??:0
@ 0x7ff3bbbcaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff3bf92d7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff3bf91c73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff3d15f81c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff3d15f7783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff3d16832a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7ff3d16830c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7ff3d16cd5e9 std::function<>::operator()() at ??:0
@ 0x7ff3d15fbcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7ff3d15f9c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff3d1681610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7ff3d1681439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ff3be815345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff3be81891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7ff3be818799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ff3be7f3eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff3c1acd6db start_thread at ??:0
@ 0x7ff3baa6361f clone at ??:0
W20260810 18:39:29.709903 32503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:29.710232 32503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:29.710407 32503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:29.717819 32503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:29.717975 32503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:29.718146 32503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:39:29.728013 32503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:43311
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=46329
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:29.729439 32503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:29.730772 32503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:29.743988 32557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:29.743960 32558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:29.744020 32561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:29.745118 32503 server_base.cc:1034] running on GCE node
I20260810 18:39:29.745692 32503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:29.746593 32503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:29.747787 32503 hybrid_clock.cc:648] HybridClock initialized: now 1786387169747740 us; error 38 us; skew 500 ppm
I20260810 18:39:29.748109 32503 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:29 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387169, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:29.755846 32503 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:39:29.761400 32503 webserver.cc:460] Webserver started at http://127.13.139.1:46329/ using document root <none> and password file <none>
I20260810 18:39:29.762352 32503 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:29.762511 32503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:29.768285 32503 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:39:29.771102 32568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:29.772509 32503 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:39:29.772675 32503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "3f3666ad3314418bac2d8a50d5f6f2d8"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "6fad8bc63c9b64895ef45b4a4ac32139"
server_key_iv: "4f75057c79c06a96c5598aaf1eb89220"
server_key_version: "encryptionkey@0"
I20260810 18:39:29.773654 32503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:29.792243 32503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:29.796149 32503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:29.796435 32503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:29.797417 32503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:29.799269 32577 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260810 18:39:29.804728 32503 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 18:39:29.804862 32503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260810 18:39:29.804994 32503 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 18:39:29.808197 32503 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 18:39:29.808303 32503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:29.808696 32577 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Bootstrap starting.
I20260810 18:39:29.835319 32577 log.cc:824] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:29.848570 32577 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 18:39:29.849202 32577 tablet_bootstrap.cc:492] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Bootstrap complete.
I20260810 18:39:29.851084 32577 ts_tablet_manager.cc:1397] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Time spent bootstrapping tablet: real 0.043s user 0.027s sys 0.011s
I20260810 18:39:29.856983 32503 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:43311
I20260810 18:39:29.857028 32708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:43311 every 8 connection(s)
I20260810 18:39:29.858295 32503 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:39:29.860024 32577 raft_consensus.cc:348] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:29.860927 32577 raft_consensus.cc:729] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3666ad3314418bac2d8a50d5f6f2d8, State: Initialized, Role: FOLLOWER
I20260810 18:39:29.861342 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 32503
I20260810 18:39:29.861577 32577 consensus_queue.cc:260] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:29.862226 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:43145
--local_ip_for_outbound_sockets=127.13.139.2
--tserver_master_addrs=127.13.139.62:46635
--webserver_port=40821
--webserver_interface=127.13.139.2
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:39:29.864164 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:29.861294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:32853)
0810 18:39:29.862586 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:29.862892 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":400,"threads_started":1}
I20260810 18:39:29.864406 32577 ts_tablet_manager.cc:1428] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
W20260810 18:39:29.867766 32709 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:46635 (0 consecutive failures): Network error: Failed to ping master at 127.13.139.62:46635: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
I20260810 18:39:29.868587 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:29.868259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:53295)
0810 18:39:29.868409 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:29.868487 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 18:39:29.869541 32712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:29.869095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:57271)
0810 18:39:29.869271 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:29.869376 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 18:39:29.869817 32709 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 18:39:30.198137 32714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:30.198411 32714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:30.198578 32714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:30.206058 32714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:30.206166 32714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:30.206363 32714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:39:30.216362 32714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:43145
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=40821
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:30.217672 32714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:30.218983 32714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:30.232306 32723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:30.232343 32721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:30.232856 32720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:30.233186 32714 server_base.cc:1034] running on GCE node
I20260810 18:39:30.233798 32714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:30.234745 32714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:30.235966 32714 hybrid_clock.cc:648] HybridClock initialized: now 1786387170235911 us; error 47 us; skew 500 ppm
I20260810 18:39:30.236312 32714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:30 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387170, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:30.239547 32714 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:39:30.241047 32714 webserver.cc:460] Webserver started at http://127.13.139.2:40821/ using document root <none> and password file <none>
I20260810 18:39:30.241676 32714 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:30.241794 32714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:30.247095 32714 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:39:30.249720 32734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:30.251096 32714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:39:30.251236 32714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "a5fa59ef678e440489df745d357caaa4"
format_stamp: "Formatted at 2026-08-10 18:38:44 on dist-test-slave-5k54"
server_key: "eb5e28ac65462818431c0a5c2ede635f"
server_key_iv: "faf23b6785f76a44bdbd3a8f9f5dc144"
server_key_version: "encryptionkey@0"
I20260810 18:39:30.252233 32714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:30.268146 32714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:30.272158 32714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:30.272377 32714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:30.273298 32714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:30.275044 32714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:30.275131 32714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:30.275207 32714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:30.275267 32714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:30.309430 32714 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:43145
I20260810 18:39:30.309518 392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:43145 every 8 connection(s)
I20260810 18:39:30.310889 32714 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:39:30.315636 395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:30.313780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:59375)
0810 18:39:30.314495 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:30.314718 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":280,"threads_started":1}
W20260810 18:39:30.316340 393 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:46635 (0 consecutive failures): Network error: Failed to ping master at 127.13.139.62:46635: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
I20260810 18:39:30.317094 395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:30.316782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:51533)
0810 18:39:30.316928 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:30.316994 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 18:39:30.317873 395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:30.317607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:36011)
0810 18:39:30.317712 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:30.317780 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 18:39:30.318174 393 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 18:39:30.321266 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 32714
I20260810 18:39:30.321871 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:40757
--local_ip_for_outbound_sockets=127.13.139.3
--tserver_master_addrs=127.13.139.62:46635
--webserver_port=35539
--webserver_interface=127.13.139.3
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:30.658046 396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:30.658309 396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:30.658475 396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:30.665478 396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:30.665575 396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:30.665786 396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:39:30.675024 396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:40757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=35539
--tserver_master_addrs=127.13.139.62:46635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:30.676232 396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:30.677589 396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:30.690457 401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:30.690431 402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:30.690690 404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:30.691700 396 server_base.cc:1034] running on GCE node
I20260810 18:39:30.692349 396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:30.693281 396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:30.694525 396 hybrid_clock.cc:648] HybridClock initialized: now 1786387170694481 us; error 29 us; skew 500 ppm
I20260810 18:39:30.694875 396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:30 dist-test-slave-5k54 krb5kdc[31191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387170, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:30.698189 396 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:39:30.699826 396 webserver.cc:460] Webserver started at http://127.13.139.3:35539/ using document root <none> and password file <none>
I20260810 18:39:30.700589 396 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:30.700704 396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:30.706372 396 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 18:39:30.709079 411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:30.710536 396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:39:30.710692 396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "69dabe2e916e42adb4a757f51af9b32f"
format_stamp: "Formatted at 2026-08-10 18:38:45 on dist-test-slave-5k54"
server_key: "3d07f496394402e52c4866eaa28a9455"
server_key_iv: "2f73382c82f71b8eafbe95338d8e203e"
server_key_version: "encryptionkey@0"
I20260810 18:39:30.711724 396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:30.728209 396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:30.732610 396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:30.732946 396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:30.733970 396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:30.735343 396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:30.735473 396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:30.735585 396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:30.735662 396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:30.769451 396 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:40757
I20260810 18:39:30.769556 535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:40757 every 8 connection(s)
I20260810 18:39:30.770939 396 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:39:30.771484 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 396
I20260810 18:39:30.776026 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:30.774220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:52915)
0810 18:39:30.774912 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:30.775122 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":271,"threads_started":1}
W20260810 18:39:30.776671 536 heartbeater.cc:644] Failed to heartbeat to 127.13.139.62:46635 (0 consecutive failures): Network error: Failed to ping master at 127.13.139.62:46635: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
I20260810 18:39:30.777504 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:30.777140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:34265)
0810 18:39:30.777276 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:30.777339 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 18:39:30.778311 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:30.778023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:40229)
0810 18:39:30.778134 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:30.778204 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 18:39:30.778537 536 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 18:39:30.872622 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:30.870304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:34819)
0810 18:39:30.872216 (+ 1912us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:30.872350 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1803,"thread_start_us":1671,"threads_started":1}
I20260810 18:39:31.129989 541 raft_consensus.cc:482] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:31.130275 541 raft_consensus.cc:504] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:31.131837 541 leader_election.cc:288] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
Aug 10 18:39:31 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387169, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
Aug 10 18:39:31 dist-test-slave-5k54 krb5kdc[31191](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387169, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:39:31.157047 542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:31.132197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:40757 (local address 127.13.139.1:45473)
0810 18:39:31.134418 (+ 2221us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:31.134441 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:31.134564 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:31.137677 (+ 3113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:31.137683 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:31.138260 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:31.139174 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:31.139201 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.141510 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.141514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:31.143860 (+ 2346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:31.143876 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.145376 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.145383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:31.145801 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:31.146697 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:31.146733 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:31.150071 (+ 3338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:31.153479 (+ 3408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:31.153485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:31.153489 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:31.153998 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:31.154416 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:31.154422 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:31.154425 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:31.154571 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:31.155280 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:31.155285 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:31.155693 (+ 408us) client_negotiation.cc:769] Sending connection context
0810 18:39:31.155975 (+ 282us) client_negotiation.cc:240] Negotiation successful
0810 18:39:31.156544 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2062,"mutex_wait_us":373,"spinlock_wait_cycles":47104,"thread_start_us":1855,"threads_started":1}
I20260810 18:39:31.157074 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:31.132537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:45473 (local address 127.13.139.3:40757)
0810 18:39:31.134782 (+ 2245us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:31.134797 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:31.134841 (+ 44us) server_negotiation.cc:407] Connection header received
0810 18:39:31.136955 (+ 2114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:31.136964 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:31.137374 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:31.137704 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:31.139388 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.141305 (+ 1917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.144031 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.145082 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.145268 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:31.150333 (+ 5065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:31.150343 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:31.150355 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:31.150395 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:31.153329 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:31.154126 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:31.154133 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:31.154146 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:31.154295 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:31.154680 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:31.154686 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:31.154689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:31.155135 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:31.155377 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:31.156196 (+ 819us) server_negotiation.cc:299] Negotiation successful
0810 18:39:31.156618 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2065,"thread_start_us":1887,"threads_started":1}
I20260810 18:39:31.157122 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:31.132131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:43145 (local address 127.13.139.1:44999)
0810 18:39:31.132451 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:31.132497 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:31.133143 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:31.137281 (+ 4138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:31.137289 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:31.138121 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:31.139174 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:31.139201 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.141506 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.141511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:31.143860 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:31.143876 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.145375 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.145383 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:31.145802 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:31.146693 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:31.146732 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:31.149732 (+ 3000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:31.153328 (+ 3596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:31.153338 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:31.153351 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:31.153844 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:31.154288 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:31.154292 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:31.154296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:31.154472 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:31.155275 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:31.155283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:31.155692 (+ 409us) client_negotiation.cc:769] Sending connection context
0810 18:39:31.155975 (+ 283us) client_negotiation.cc:240] Negotiation successful
0810 18:39:31.156678 (+ 703us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":502,"spinlock_wait_cycles":27264}
I20260810 18:39:31.157083 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:31.132442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:44999 (local address 127.13.139.2:43145)
0810 18:39:31.134021 (+ 1579us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:31.134042 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:31.134087 (+ 45us) server_negotiation.cc:407] Connection header received
0810 18:39:31.136282 (+ 2195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:31.136294 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:31.136805 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:31.137150 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:31.139387 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.141305 (+ 1918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.144031 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:31.145092 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:31.145273 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:31.150036 (+ 4763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:31.150044 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:31.150058 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:31.150094 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:31.153186 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:31.153979 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:31.153988 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:31.153995 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:31.154165 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:31.154591 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:31.154596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:31.154599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:31.155129 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:31.155323 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:31.156189 (+ 866us) server_negotiation.cc:299] Negotiation successful
0810 18:39:31.156612 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1348,"thread_start_us":1223,"threads_started":1}
W20260810 18:39:31.160594 32572 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
W20260810 18:39:31.160898 32570 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
I20260810 18:39:31.161036 32570 leader_election.cc:302] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8; no voters: 69dabe2e916e42adb4a757f51af9b32f, a5fa59ef678e440489df745d357caaa4
I20260810 18:39:31.161427 541 raft_consensus.cc:2726] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 18:39:31.319548 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:31.318631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:38957)
0810 18:39:31.319084 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:31.319248 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":217,"threads_started":1}
I20260810 18:39:31.779758 547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:31.779000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:52141)
0810 18:39:31.779401 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:31.779559 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":193,"threads_started":1}
I20260810 18:39:31.874326 548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:31.873611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:40143)
0810 18:39:31.874063 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:31.874152 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":242,"threads_started":1}
I20260810 18:39:32.321005 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:32.320336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:59079)
0810 18:39:32.320772 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:32.320853 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":231,"threads_started":1}
I20260810 18:39:32.781278 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:32.780562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:52393)
0810 18:39:32.781024 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:32.781104 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":229,"threads_started":1}
I20260810 18:39:32.876240 551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:32.875319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:44537)
0810 18:39:32.875890 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:32.876019 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":311,"threads_started":1}
I20260810 18:39:33.322433 553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:33.321786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:46099)
0810 18:39:33.322199 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:33.322275 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":222,"threads_started":1}
I20260810 18:39:33.406224 554 raft_consensus.cc:482] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:33.406438 554 raft_consensus.cc:504] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:33.407025 554 leader_election.cc:288] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
W20260810 18:39:33.408106 32572 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
W20260810 18:39:33.408272 32570 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
I20260810 18:39:33.408416 32570 leader_election.cc:302] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8; no voters: 69dabe2e916e42adb4a757f51af9b32f, a5fa59ef678e440489df745d357caaa4
I20260810 18:39:33.408666 554 raft_consensus.cc:2726] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 18:39:33.782795 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:33.782126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:58619)
0810 18:39:33.782563 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:33.782643 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":236,"threads_started":1}
I20260810 18:39:33.878062 556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:33.877239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:48761)
0810 18:39:33.877712 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:33.877810 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":243,"threads_started":1}
I20260810 18:39:34.324085 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:34.323236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:57727)
0810 18:39:34.323787 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:34.323881 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":286,"threads_started":1}
I20260810 18:39:34.784377 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:34.783687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:57713)
0810 18:39:34.784098 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:34.784186 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":196,"threads_started":1}
I20260810 18:39:34.879997 559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:34.879173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:38279)
0810 18:39:34.879708 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:34.879786 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":295,"threads_started":1}
I20260810 18:39:35.325861 560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:35.325090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:56839)
0810 18:39:35.325612 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:35.325704 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":293,"threads_started":1}
I20260810 18:39:35.786145 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:35.785323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:37825)
0810 18:39:35.785877 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:35.785992 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":342,"threads_started":1}
I20260810 18:39:35.881589 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:35.880881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:38255)
0810 18:39:35.881321 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:35.881422 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":243,"threads_started":1}
I20260810 18:39:36.154520 563 raft_consensus.cc:482] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:36.154805 563 raft_consensus.cc:504] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:36.155674 563 leader_election.cc:288] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
W20260810 18:39:36.156674 32570 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
W20260810 18:39:36.156912 32572 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
I20260810 18:39:36.157127 32572 leader_election.cc:302] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8; no voters: 69dabe2e916e42adb4a757f51af9b32f, a5fa59ef678e440489df745d357caaa4
I20260810 18:39:36.157403 563 raft_consensus.cc:2726] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 18:39:36.327512 564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:36.326709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:41731)
0810 18:39:36.327171 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:36.327250 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":258,"threads_started":1}
I20260810 18:39:36.787684 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:36.786973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:36543)
0810 18:39:36.787404 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:36.787506 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":227,"threads_started":1}
I20260810 18:39:36.883229 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:36.882511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:42701)
0810 18:39:36.882959 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:36.883041 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":242,"threads_started":1}
I20260810 18:39:37.329558 567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:37.328550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:38987)
0810 18:39:37.329226 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:37.329314 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":260,"threads_started":1}
I20260810 18:39:37.789424 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:37.788618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:53801)
0810 18:39:37.789129 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:37.789214 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":248,"threads_started":1}
I20260810 18:39:37.885193 569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:37.884280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:49315)
0810 18:39:37.884945 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:37.885039 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":342,"threads_started":1}
I20260810 18:39:38.331290 571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:38.330593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:54513)
0810 18:39:38.331022 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:38.331105 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":215,"threads_started":1}
I20260810 18:39:38.621570 572 raft_consensus.cc:482] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:38.621773 572 raft_consensus.cc:504] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:38.622764 572 leader_election.cc:288] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
W20260810 18:39:38.623387 32570 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
W20260810 18:39:38.623591 32572 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
I20260810 18:39:38.623744 32572 leader_election.cc:302] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8; no voters: 69dabe2e916e42adb4a757f51af9b32f, a5fa59ef678e440489df745d357caaa4
I20260810 18:39:38.624083 572 raft_consensus.cc:2726] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 18:39:38.791098 574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:38.790406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:49087)
0810 18:39:38.790834 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:38.790920 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":231,"threads_started":1}
I20260810 18:39:38.886986 575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:38.886106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:55007)
0810 18:39:38.886634 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:38.886771 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":262,"threads_started":1}
I20260810 18:39:39.332872 576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:39.332176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:59489)
0810 18:39:39.332642 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:39.332723 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":236,"threads_started":1}
I20260810 18:39:39.792732 578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:39.792024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:38727)
0810 18:39:39.792494 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:39.792582 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":212,"threads_started":1}
I20260810 18:39:39.888952 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:39.888137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:42407)
0810 18:39:39.888663 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:39.888754 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":301,"threads_started":1}
I20260810 18:39:40.334556 581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:40.333840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:36933)
0810 18:39:40.334284 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:40.334371 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":233,"threads_started":1}
I20260810 18:39:40.794334 582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:40.793654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:37773)
0810 18:39:40.794068 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:40.794150 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":229,"threads_started":1}
I20260810 18:39:40.890595 583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:40.889855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:36017)
0810 18:39:40.890314 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:40.890421 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":231,"threads_started":1}
I20260810 18:39:41.336261 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:41.335517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:57097)
0810 18:39:41.336013 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:41.336100 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":231,"threads_started":1}
I20260810 18:39:41.796159 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:41.795388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:53883)
0810 18:39:41.795918 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:41.796002 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":241,"threads_started":1}
I20260810 18:39:41.892303 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:41.891598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:45003)
0810 18:39:41.892053 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:41.892131 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":251,"threads_started":1}
I20260810 18:39:42.337919 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:42.337169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:34997)
0810 18:39:42.337640 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:42.337742 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":250,"threads_started":1}
I20260810 18:39:42.797803 589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:42.797093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:44051)
0810 18:39:42.797557 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:42.797637 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":227,"threads_started":1}
I20260810 18:39:42.894101 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:42.893246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:50629)
0810 18:39:42.893842 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:42.893928 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":356,"threads_started":1}
I20260810 18:39:43.339764 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:43.338870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:49373)
0810 18:39:43.339481 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:43.339590 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":298,"threads_started":1}
I20260810 18:39:43.799394 592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:43.798644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:55269)
0810 18:39:43.799141 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:43.799227 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":276,"threads_started":1}
I20260810 18:39:43.896003 593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:43.895051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:58295)
0810 18:39:43.895720 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:43.895802 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":300,"threads_started":1}
I20260810 18:39:43.930626 595 raft_consensus.cc:482] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:43.930919 595 raft_consensus.cc:504] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5fa59ef678e440489df745d357caaa4" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 43145 } } peers { permanent_uuid: "69dabe2e916e42adb4a757f51af9b32f" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 40757 } } peers { permanent_uuid: "3f3666ad3314418bac2d8a50d5f6f2d8" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43311 } }
I20260810 18:39:43.931757 595 leader_election.cc:288] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145), 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757)
W20260810 18:39:43.932745 32570 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5fa59ef678e440489df745d357caaa4 (127.13.139.2:43145): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
W20260810 18:39:43.932973 32572 leader_election.cc:341] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 69dabe2e916e42adb4a757f51af9b32f (127.13.139.3:40757): Not found: Tablet not found: d90c3d0cc54540a496c537997265a318
I20260810 18:39:43.933116 32572 leader_election.cc:302] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f3666ad3314418bac2d8a50d5f6f2d8; no voters: 69dabe2e916e42adb4a757f51af9b32f, a5fa59ef678e440489df745d357caaa4
I20260810 18:39:43.933375 595 raft_consensus.cc:2726] T d90c3d0cc54540a496c537997265a318 P 3f3666ad3314418bac2d8a50d5f6f2d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 18:39:44.341598 596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:44.340817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:32839)
0810 18:39:44.341275 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:44.341368 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":257,"threads_started":1}
I20260810 18:39:44.801017 597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:44.800298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:43115)
0810 18:39:44.800716 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:44.800805 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":208,"threads_started":1}
I20260810 18:39:44.897975 598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:44.897250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.1:46513)
0810 18:39:44.897708 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:44.897795 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":223,"threads_started":1}
I20260810 18:39:45.343379 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:45.342650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.2:35439)
0810 18:39:45.343115 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:45.343215 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":240,"threads_started":1}
I20260810 18:39:45.775099 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 32503
I20260810 18:39:45.790416 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:45.776350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36778 (local address 127.13.139.1:43311)
0810 18:39:45.776957 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:45.776964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:45.776990 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:39:45.777049 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:45.777055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:45.777267 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:45.777393 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:45.778960 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:45.780038 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:45.781293 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:45.781904 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:45.782023 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:45.784888 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:45.784900 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:45.784918 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:45.784955 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:45.787830 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:45.788489 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:45.788496 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:45.788498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:45.788653 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:45.788988 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:45.788991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:45.788993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:45.789350 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:45.789601 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:45.789831 (+ 230us) server_negotiation.cc:299] Negotiation successful
0810 18:39:45.790033 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":287,"threads_started":1}
I20260810 18:39:45.791863 32702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:45.802950 603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:45.802154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46635 (local address 127.13.139.3:50083)
0810 18:39:45.802644 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:45.802758 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.62:46635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":273,"threads_started":1}
I20260810 18:39:45.883111 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 32503
I20260810 18:39:45.905831 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 32714
I20260810 18:39:45.919874 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:45.906688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51332 (local address 127.13.139.2:43145)
0810 18:39:45.907246 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:45.907250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:45.907267 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:39:45.907323 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:45.907327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:45.907385 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:45.907546 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:45.908948 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:45.909704 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:45.910883 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:45.911299 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:45.911389 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:45.914212 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:45.914217 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:45.914220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:45.914250 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:45.917266 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:45.917955 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:45.917959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:45.917961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:45.918102 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:45.918452 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:45.918456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:45.918458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:45.918722 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:45.918921 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:45.919224 (+ 303us) server_negotiation.cc:299] Negotiation successful
0810 18:39:45.919464 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":341,"threads_started":1}
I20260810 18:39:45.920629 388 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:46.009603 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 32714
I20260810 18:39:46.029991 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 396
I20260810 18:39:46.043936 606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:46.030762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43198 (local address 127.13.139.3:40757)
0810 18:39:46.031480 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:46.031487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:46.031509 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:39:46.031590 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:46.031593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:46.031664 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:46.031794 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:46.033304 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:46.034126 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:46.035281 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:46.035909 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:46.036016 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:46.038534 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:46.038538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:46.038542 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:46.038573 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:46.041414 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:46.042069 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:46.042073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:46.042075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:46.042214 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:46.042577 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:46.042580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:46.042583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:46.042855 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:46.043065 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:46.043327 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 18:39:46.043632 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":389,"threads_started":1}
I20260810 18:39:46.044631 530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:46.129601 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 396
2026-08-10T18:39:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64566 ms)
[----------] 30 tests from SecurityITest (306158 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:39:46 dist-test-slave-5k54 krb5kdc[610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:39:46 dist-test-slave-5k54 krb5kdc[610](info): set up 2 sockets
Aug 10 18:39:46 dist-test-slave-5k54 krb5kdc[610](info): commencing operation
krb5kdc: starting...
W20260810 18:39:47.325940 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:39:47 dist-test-slave-5k54 krb5kdc[610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:39:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:39:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:39:47.630654 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37867
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:37867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:47.969424 623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:47.969691 623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:47.969890 623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:47.977335 623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:39:47.977452 623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:47.977556 623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:47.977634 623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:39:47.977710 623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:39:47.987759 623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:37867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:47.989122 623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:47.990477 623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:48.002521 633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:48.002521 630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:48.002611 631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:48.003022 623 server_base.cc:1034] running on GCE node
I20260810 18:39:48.004151 623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:48.005565 623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:48.006807 623 hybrid_clock.cc:648] HybridClock initialized: now 1786387188006757 us; error 41 us; skew 500 ppm
I20260810 18:39:48.007162 623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:48 dist-test-slave-5k54 krb5kdc[610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387188, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:48.010426 623 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:39:48.012113 623 webserver.cc:460] Webserver started at http://127.13.139.62:37975/ using document root <none> and password file <none>
I20260810 18:39:48.012801 623 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:48.012957 623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:48.013305 623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:48.016377 623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "bbd244714dd247e28333e37c5e486500"
format_stamp: "Formatted at 2026-08-10 18:39:48 on dist-test-slave-5k54"
server_key: "6ae9c6e0936d2bc20c8b32514803e7d0"
server_key_iv: "fe5ef732035e8098e75c4617ff06312b"
server_key_version: "encryptionkey@0"
I20260810 18:39:48.017133 623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "bbd244714dd247e28333e37c5e486500"
format_stamp: "Formatted at 2026-08-10 18:39:48 on dist-test-slave-5k54"
server_key: "6ae9c6e0936d2bc20c8b32514803e7d0"
server_key_iv: "fe5ef732035e8098e75c4617ff06312b"
server_key_version: "encryptionkey@0"
I20260810 18:39:48.022226 623 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:39:48.025645 640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:48.026860 623 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:39:48.027043 623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "bbd244714dd247e28333e37c5e486500"
format_stamp: "Formatted at 2026-08-10 18:39:48 on dist-test-slave-5k54"
server_key: "6ae9c6e0936d2bc20c8b32514803e7d0"
server_key_iv: "fe5ef732035e8098e75c4617ff06312b"
server_key_version: "encryptionkey@0"
I20260810 18:39:48.027240 623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:48.042399 623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:48.046350 623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:48.046633 623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:48.066393 623 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:37867
I20260810 18:39:48.066480 695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:37867 every 8 connection(s)
I20260810 18:39:48.067790 623 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:39:48.069967 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 623
I20260810 18:39:48.070233 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:39:48.071210 13868 external_mini_cluster.cc:1428] Setting key 40c3eccab94701e826a1187b6229cdfa
I20260810 18:39:48.072656 696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 18:39:48 dist-test-slave-5k54 krb5kdc[610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:48.087817 696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500: Bootstrap starting.
I20260810 18:39:48.091197 696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:48.092389 696 log.cc:824] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:48.095615 696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500: No bootstrap required, opened a new log
I20260810 18:39:48.095664 699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:48.073401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34244 (local address 127.13.139.62:37867)
0810 18:39:48.074188 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:48.074204 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:48.074269 (+ 65us) server_negotiation.cc:407] Connection header received
0810 18:39:48.076561 (+ 2292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:48.076588 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:48.077130 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:48.077597 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:48.078987 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:48.081291 (+ 2304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:48.082648 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:48.083819 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:48.084026 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:48.088235 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:48.088242 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:48.088256 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:48.088294 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:48.091584 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:48.092290 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:48.092298 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:48.092310 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:48.092473 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:48.092875 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:48.092881 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:48.092884 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:48.093420 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:48.093745 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:48.094201 (+ 456us) server_negotiation.cc:299] Negotiation successful
0810 18:39:48.094650 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":313,"threads_started":1}
I20260810 18:39:48.104714 696 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd244714dd247e28333e37c5e486500" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37867 } }
I20260810 18:39:48.105168 696 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:48.105297 696 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbd244714dd247e28333e37c5e486500, State: Initialized, Role: FOLLOWER
I20260810 18:39:48.106015 696 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd244714dd247e28333e37c5e486500" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37867 } }
I20260810 18:39:48.106343 696 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:39:48.106508 696 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:39:48.106707 696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:48.109221 696 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd244714dd247e28333e37c5e486500" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37867 } }
I20260810 18:39:48.109761 696 leader_election.cc:302] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbd244714dd247e28333e37c5e486500; no voters:
I20260810 18:39:48.110518 696 leader_election.cc:288] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:39:48.110657 701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:48.111577 701 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [term 1 LEADER]: Becoming Leader. State: Replica: bbd244714dd247e28333e37c5e486500, State: Running, Role: LEADER
I20260810 18:39:48.112136 701 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd244714dd247e28333e37c5e486500" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37867 } }
I20260810 18:39:48.112916 696 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:39:48.115172 704 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbd244714dd247e28333e37c5e486500. Latest consensus state: current_term: 1 leader_uuid: "bbd244714dd247e28333e37c5e486500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd244714dd247e28333e37c5e486500" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37867 } } }
I20260810 18:39:48.115722 704 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:48.115720 703 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbd244714dd247e28333e37c5e486500" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd244714dd247e28333e37c5e486500" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37867 } } }
I20260810 18:39:48.116065 703 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500 [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:48.117986 711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:39:48.124092 711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:39:48.134320 711 catalog_manager.cc:1347] Generated new cluster ID: 2f904790d62e443a8a6d31f2ca6e9f69
I20260810 18:39:48.134510 711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:39:48.150604 711 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:39:48.151937 711 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:39:48.164359 711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500: Generated new TSK 0
I20260810 18:39:48.165190 711 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:39:48.243851 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37867
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:48.589044 724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:48.589313 724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:48.589483 724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:48.597030 724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:48.597157 724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:48.597335 724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:39:48.607127 724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37867
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:48.608410 724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:48.609715 724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:48.622907 731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:48.622922 734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:48.623217 736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:48.624135 724 server_base.cc:1034] running on GCE node
I20260810 18:39:48.624677 724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:48.625685 724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:48.626879 724 hybrid_clock.cc:648] HybridClock initialized: now 1786387188626826 us; error 53 us; skew 500 ppm
I20260810 18:39:48.627195 724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:48 dist-test-slave-5k54 krb5kdc[610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387188, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:48.630450 724 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:39:48.632120 724 webserver.cc:460] Webserver started at http://127.13.139.1:46183/ using document root <none> and password file <none>
I20260810 18:39:48.632810 724 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:48.632923 724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:48.633270 724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:48.636488 724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "d3c819fdccef4e9caf9ff7afdaf6312e"
format_stamp: "Formatted at 2026-08-10 18:39:48 on dist-test-slave-5k54"
server_key: "ffa488d00993ad7ebcec1892ad8e9129"
server_key_iv: "061adfde63366469edd45b096dd33109"
server_key_version: "encryptionkey@0"
I20260810 18:39:48.637312 724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "d3c819fdccef4e9caf9ff7afdaf6312e"
format_stamp: "Formatted at 2026-08-10 18:39:48 on dist-test-slave-5k54"
server_key: "ffa488d00993ad7ebcec1892ad8e9129"
server_key_iv: "061adfde63366469edd45b096dd33109"
server_key_version: "encryptionkey@0"
I20260810 18:39:48.642735 724 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:39:48.646425 743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:48.647883 724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 18:39:48.648079 724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "d3c819fdccef4e9caf9ff7afdaf6312e"
format_stamp: "Formatted at 2026-08-10 18:39:48 on dist-test-slave-5k54"
server_key: "ffa488d00993ad7ebcec1892ad8e9129"
server_key_iv: "061adfde63366469edd45b096dd33109"
server_key_version: "encryptionkey@0"
I20260810 18:39:48.648293 724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:48.665230 724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:48.669497 724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:48.669797 724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:48.670754 724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:48.672230 724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:48.672336 724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:48.672487 724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:48.672560 724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:48.706884 724 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:43009
I20260810 18:39:48.706938 868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:43009 every 8 connection(s)
I20260810 18:39:48.708338 724 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:39:48.715328 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 724
I20260810 18:39:48.715595 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:39:48.716338 13868 external_mini_cluster.cc:1428] Setting key d58ea2fa23b9875496c632b887a4bb03
Aug 10 18:39:48 dist-test-slave-5k54 krb5kdc[610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387188, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:48.729015 871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:48.711065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:52941 (local address 127.13.139.62:37867)
0810 18:39:48.711617 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:48.711622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:48.712614 (+ 992us) server_negotiation.cc:407] Connection header received
0810 18:39:48.714503 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:48.714508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:48.714601 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:48.714724 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:48.716399 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:48.717378 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:48.719173 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:48.719656 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:48.719796 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:48.723213 (+ 3417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:48.723219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:48.723222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:48.723253 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:48.725922 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:48.726670 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:48.726676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:48.726684 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:48.726804 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:48.727245 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:48.727250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:48.727253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:48.727577 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:48.727733 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:48.728412 (+ 679us) server_negotiation.cc:299] Negotiation successful
0810 18:39:48.728641 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":247,"threads_started":1}
I20260810 18:39:48.729987 872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:48.711661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37867 (local address 127.13.139.1:52941)
0810 18:39:48.712434 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:48.712482 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:48.714231 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:48.714986 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:48.714994 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:48.715619 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:48.716226 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:48.716242 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:48.717571 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:48.717575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:48.719029 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:48.719041 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:48.719882 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:48.719890 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:48.720149 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:48.720827 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:48.720850 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:48.722993 (+ 2143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:48.726081 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:48.726089 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:48.726105 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:48.726537 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:48.726918 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:48.726926 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:48.726930 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:48.727126 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:48.727706 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:48.727713 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:48.728044 (+ 331us) client_negotiation.cc:769] Sending connection context
0810 18:39:48.728320 (+ 276us) client_negotiation.cc:240] Negotiation successful
0810 18:39:48.728847 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":317,"threads_started":1}
I20260810 18:39:48.731628 869 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37867
I20260810 18:39:48.731933 869 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:48.732613 869 heartbeater.cc:511] Master 127.13.139.62:37867 requested a full tablet report, sending...
I20260810 18:39:48.734822 658 ts_manager.cc:194] Registered new tserver with Master: d3c819fdccef4e9caf9ff7afdaf6312e (127.13.139.1:43009)
I20260810 18:39:48.736379 658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:52941
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:39:48.780683 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37867
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:49.118517 875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:49.118788 875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:49.118886 875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:49.126139 875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:49.126255 875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:49.126367 875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:39:49.136284 875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37867
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:49.137496 875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:49.138855 875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:49.151989 881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:49.151958 882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:49.152132 884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:49.152974 875 server_base.cc:1034] running on GCE node
I20260810 18:39:49.153563 875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:49.154469 875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:49.155694 875 hybrid_clock.cc:648] HybridClock initialized: now 1786387189155654 us; error 54 us; skew 500 ppm
I20260810 18:39:49.156003 875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:49 dist-test-slave-5k54 krb5kdc[610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387189, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:49.159085 875 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:39:49.160674 875 webserver.cc:460] Webserver started at http://127.13.139.2:36441/ using document root <none> and password file <none>
I20260810 18:39:49.161341 875 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:49.161501 875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:49.161818 875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:49.164979 875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "9138070a5de44d02889e5dc26da54170"
format_stamp: "Formatted at 2026-08-10 18:39:49 on dist-test-slave-5k54"
server_key: "d7c9588fff7ce64b4763a85a62bbe9d8"
server_key_iv: "04a9e4a37e5bdce517f2b2a846e0108f"
server_key_version: "encryptionkey@0"
I20260810 18:39:49.165753 875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "9138070a5de44d02889e5dc26da54170"
format_stamp: "Formatted at 2026-08-10 18:39:49 on dist-test-slave-5k54"
server_key: "d7c9588fff7ce64b4763a85a62bbe9d8"
server_key_iv: "04a9e4a37e5bdce517f2b2a846e0108f"
server_key_version: "encryptionkey@0"
I20260810 18:39:49.170804 875 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:39:49.174312 892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:49.175618 875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:49.175778 875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "9138070a5de44d02889e5dc26da54170"
format_stamp: "Formatted at 2026-08-10 18:39:49 on dist-test-slave-5k54"
server_key: "d7c9588fff7ce64b4763a85a62bbe9d8"
server_key_iv: "04a9e4a37e5bdce517f2b2a846e0108f"
server_key_version: "encryptionkey@0"
I20260810 18:39:49.175961 875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:49.194888 875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:49.198879 875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:49.199198 875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:49.200201 875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:49.201532 875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:49.201642 875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:49.201802 875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:49.201879 875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:49.237416 875 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:39363
I20260810 18:39:49.237452 1019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:39363 every 8 connection(s)
I20260810 18:39:49.238773 875 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:39:49.249202 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 875
I20260810 18:39:49.249403 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:39:49.249953 13868 external_mini_cluster.cc:1428] Setting key fde372a5d556cc616d4982704891c3f2
Aug 10 18:39:49 dist-test-slave-5k54 krb5kdc[610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387189, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:49.259472 1022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.241291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:57119 (local address 127.13.139.62:37867)
0810 18:39:49.241720 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.241724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.242714 (+ 990us) server_negotiation.cc:407] Connection header received
0810 18:39:49.244617 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.244623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.244714 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.244838 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:49.246340 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.247076 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.248674 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.249372 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.249522 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.253460 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:49.253464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:49.253468 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:49.253500 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:49.256290 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:49.257054 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:49.257060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:49.257064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:49.257228 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:49.257678 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:49.257687 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:49.257689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:49.257958 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:49.258133 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.258839 (+ 706us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.259063 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":218,"threads_started":1}
I20260810 18:39:49.260387 1023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.241865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37867 (local address 127.13.139.2:57119)
0810 18:39:49.242559 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:49.242600 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:49.244349 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:49.245082 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:49.245090 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:49.245609 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:49.246161 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.246178 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.247235 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.247241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.248523 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.248534 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.249622 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.249627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.249828 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.250553 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:49.250580 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:49.253229 (+ 2649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:49.256474 (+ 3245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:49.256482 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:49.256497 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:49.256922 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:49.257345 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:49.257350 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:49.257355 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:49.257552 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:49.258090 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:49.258099 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:49.258435 (+ 336us) client_negotiation.cc:769] Sending connection context
0810 18:39:49.258730 (+ 295us) client_negotiation.cc:240] Negotiation successful
0810 18:39:49.259244 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":268,"threads_started":1}
I20260810 18:39:49.261845 1020 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37867
I20260810 18:39:49.262149 1020 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:49.262862 1020 heartbeater.cc:511] Master 127.13.139.62:37867 requested a full tablet report, sending...
I20260810 18:39:49.264395 658 ts_manager.cc:194] Registered new tserver with Master: 9138070a5de44d02889e5dc26da54170 (127.13.139.2:39363)
I20260810 18:39:49.265235 658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:57119
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:39:49.316331 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37867
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:35369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:49.654901 1026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:49.655174 1026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:49.655350 1026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:49.662761 1026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:49.662881 1026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:49.663092 1026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:39:49.672866 1026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:35369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:37867
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:49.674219 1026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:49.675509 1026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:49.688912 1036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:49.688958 1034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:49.689080 1033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:49.690016 1026 server_base.cc:1034] running on GCE node
I20260810 18:39:49.690562 1026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:49.691512 1026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:49.692725 1026 hybrid_clock.cc:648] HybridClock initialized: now 1786387189692687 us; error 30 us; skew 500 ppm
I20260810 18:39:49.693027 1026 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:49 dist-test-slave-5k54 krb5kdc[610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387189, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:49.701622 1026 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:39:49.703295 1026 webserver.cc:460] Webserver started at http://127.13.139.3:45851/ using document root <none> and password file <none>
I20260810 18:39:49.704013 1026 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:49.704149 1026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:49.704488 1026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:49.707472 1026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "9fdbb82233724695bb7fdb84d642b388"
format_stamp: "Formatted at 2026-08-10 18:39:49 on dist-test-slave-5k54"
server_key: "36ba047d63d4e16ff625dc22f4af8c8e"
server_key_iv: "bd9b832a27c61d3a369cf8aa53d7e8be"
server_key_version: "encryptionkey@0"
I20260810 18:39:49.708249 1026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "9fdbb82233724695bb7fdb84d642b388"
format_stamp: "Formatted at 2026-08-10 18:39:49 on dist-test-slave-5k54"
server_key: "36ba047d63d4e16ff625dc22f4af8c8e"
server_key_iv: "bd9b832a27c61d3a369cf8aa53d7e8be"
server_key_version: "encryptionkey@0"
I20260810 18:39:49.713431 1026 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260810 18:39:49.717083 1044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:49.718448 1026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260810 18:39:49.718626 1026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "9fdbb82233724695bb7fdb84d642b388"
format_stamp: "Formatted at 2026-08-10 18:39:49 on dist-test-slave-5k54"
server_key: "36ba047d63d4e16ff625dc22f4af8c8e"
server_key_iv: "bd9b832a27c61d3a369cf8aa53d7e8be"
server_key_version: "encryptionkey@0"
I20260810 18:39:49.718842 1026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:49.739312 1026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:49.739341 869 heartbeater.cc:503] Master 127.13.139.62:37867 was elected leader, sending a full tablet report...
I20260810 18:39:49.744095 1026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:49.744438 1026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:49.745527 1026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:49.746991 1026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:49.747108 1026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:49.747285 1026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:49.747370 1026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:49.784539 1026 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:39563
I20260810 18:39:49.784581 1171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:39563 every 8 connection(s)
I20260810 18:39:49.785993 1026 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:39:49.796360 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 1026
I20260810 18:39:49.796623 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:39:49.797197 13868 external_mini_cluster.cc:1428] Setting key 1c902e5749fecb45dc0ff608de85a6a4
Aug 10 18:39:49 dist-test-slave-5k54 krb5kdc[610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387189, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:49.809084 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.788623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:53785 (local address 127.13.139.62:37867)
0810 18:39:49.789135 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.789141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.790112 (+ 971us) server_negotiation.cc:407] Connection header received
0810 18:39:49.792001 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.792006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.792085 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.792182 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:49.793607 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.794409 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.796014 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.796610 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.796749 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.801428 (+ 4679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:49.801437 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:49.801442 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:49.801489 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:49.806353 (+ 4864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:49.807062 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:49.807066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:49.807068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:49.807201 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:49.807643 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:49.807646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:49.807648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:49.807916 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:49.808033 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.808647 (+ 614us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.808801 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":242,"threads_started":1}
I20260810 18:39:49.810029 1175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.789218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:37867 (local address 127.13.139.3:53785)
0810 18:39:49.789938 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:49.789980 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:49.791743 (+ 1763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:49.792385 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:49.792392 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:49.792919 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:49.793460 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.793477 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.794545 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.794549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.795861 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.795873 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.796941 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.796951 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.797261 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.798124 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:49.798168 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:49.801176 (+ 3008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:49.806494 (+ 5318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:49.806508 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:49.806520 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:49.806948 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:49.807290 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:49.807294 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:49.807296 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:49.807541 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:49.808018 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:49.808024 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:49.808323 (+ 299us) client_negotiation.cc:769] Sending connection context
0810 18:39:49.808539 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 18:39:49.808913 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":285,"threads_started":1}
I20260810 18:39:49.811508 1172 heartbeater.cc:347] Connected to a master server at 127.13.139.62:37867
I20260810 18:39:49.811779 1172 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:49.812788 1172 heartbeater.cc:511] Master 127.13.139.62:37867 requested a full tablet report, sending...
I20260810 18:39:49.814468 658 ts_manager.cc:194] Registered new tserver with Master: 9fdbb82233724695bb7fdb84d642b388 (127.13.139.3:39563)
I20260810 18:39:49.815269 658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:53785
I20260810 18:39:49.826306 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:39:49.844472 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.830988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34250 (local address 127.13.139.62:37867)
0810 18:39:49.831184 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.831192 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.831669 (+ 477us) server_negotiation.cc:407] Connection header received
0810 18:39:49.831879 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.831889 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.831999 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.832106 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:49.833601 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.834352 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.835813 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.836222 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.836368 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.838710 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:49.838715 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:49.838718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:49.838750 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:49.841871 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:49.842561 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:49.842564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:49.842567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:49.842685 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:49.843054 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:49.843058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:49.843060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:49.843394 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:49.843673 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.843923 (+ 250us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.844128 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 18:39:49.848927 658 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:39:49.856415 658 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:39:49.891319 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.869222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57148 (local address 127.13.139.2:39363)
0810 18:39:49.880353 (+ 11131us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.880367 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.881525 (+ 1158us) server_negotiation.cc:407] Connection header received
0810 18:39:49.881886 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.881894 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.882156 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.883237 (+ 1081us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:49.884211 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.885791 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.888363 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.889746 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.889844 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.890036 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.890773 (+ 737us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.890964 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10905,"thread_start_us":10549,"threads_started":1}
I20260810 18:39:49.891785 1187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.868867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:39563 (local address 127.0.0.1:36698)
0810 18:39:49.881394 (+ 12527us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:49.881410 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:49.881617 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:49.882730 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:49.882739 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:49.882774 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:49.883232 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.883247 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.885364 (+ 2117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.885369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.888022 (+ 2653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.888037 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.890220 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.890228 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.890438 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.891034 (+ 596us) client_negotiation.cc:769] Sending connection context
0810 18:39:49.891131 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 18:39:49.891326 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12419,"mutex_wait_us":537,"thread_start_us":12265,"threads_started":1}
I20260810 18:39:49.891981 1189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.869148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36698 (local address 127.13.139.3:39563)
0810 18:39:49.880963 (+ 11815us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.880971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.881828 (+ 857us) server_negotiation.cc:407] Connection header received
0810 18:39:49.881934 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.881940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.882156 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.882353 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:49.883471 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.885195 (+ 1724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.888222 (+ 3027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.889686 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.889827 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.890065 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.891226 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.891489 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11602,"thread_start_us":11420,"threads_started":1}
I20260810 18:39:49.892493 1186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.868816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:39363 (local address 127.0.0.1:57148)
0810 18:39:49.881323 (+ 12507us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:49.881384 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:49.881617 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:49.883559 (+ 1942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:49.883565 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:49.883595 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:49.884006 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.884018 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.885965 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.885970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.888198 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.888211 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.890238 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.890243 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.890467 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.890538 (+ 71us) client_negotiation.cc:769] Sending connection context
0810 18:39:49.891906 (+ 1368us) client_negotiation.cc:240] Negotiation successful
0810 18:39:49.892032 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12182,"mutex_wait_us":10,"thread_start_us":12406,"threads_started":1}
I20260810 18:39:49.896368 948 tablet_service.cc:1467] Processing CreateTablet for tablet a2a6fa7083044cb48a92aac2131c683c (DEFAULT_TABLE table=test-table [id=62d6da201acc4485aebab36d79f25705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:49.896561 1099 tablet_service.cc:1467] Processing CreateTablet for tablet a2a6fa7083044cb48a92aac2131c683c (DEFAULT_TABLE table=test-table [id=62d6da201acc4485aebab36d79f25705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:49.897810 1099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2a6fa7083044cb48a92aac2131c683c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:49.897819 948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2a6fa7083044cb48a92aac2131c683c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:49.900197 1187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.883029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43009 (local address 127.0.0.1:40004)
0810 18:39:49.892185 (+ 9156us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:49.892205 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:49.892313 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:49.893566 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:49.893574 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:49.893597 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:49.893756 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.893769 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.895763 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.895768 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.897582 (+ 1814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.897597 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.899452 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.899460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.899634 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.899670 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 18:39:49.899781 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 18:39:49.899940 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9056,"thread_start_us":9660,"threads_started":1}
I20260810 18:39:49.900315 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.882285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40004 (local address 127.13.139.1:43009)
0810 18:39:49.890950 (+ 8665us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.890959 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.892472 (+ 1513us) server_negotiation.cc:407] Connection header received
0810 18:39:49.892591 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.892602 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.892868 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.893083 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:49.893942 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.895603 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.897801 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.899214 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.899382 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.899642 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.899841 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.899996 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8474,"thread_start_us":8345,"threads_started":1}
I20260810 18:39:49.903983 794 tablet_service.cc:1467] Processing CreateTablet for tablet a2a6fa7083044cb48a92aac2131c683c (DEFAULT_TABLE table=test-table [id=62d6da201acc4485aebab36d79f25705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:49.905445 794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2a6fa7083044cb48a92aac2131c683c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:49.909610 1192 tablet_bootstrap.cc:492] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Bootstrap starting.
I20260810 18:39:49.913131 1193 tablet_bootstrap.cc:492] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Bootstrap starting.
I20260810 18:39:49.913621 1192 tablet_bootstrap.cc:654] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:49.915160 1192 log.cc:824] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:49.916673 1193 tablet_bootstrap.cc:654] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:49.917764 1193 log.cc:824] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:49.918321 1192 tablet_bootstrap.cc:492] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: No bootstrap required, opened a new log
I20260810 18:39:49.918655 1192 ts_tablet_manager.cc:1397] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260810 18:39:49.919801 1196 tablet_bootstrap.cc:492] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Bootstrap starting.
I20260810 18:39:49.921541 1193 tablet_bootstrap.cc:492] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: No bootstrap required, opened a new log
I20260810 18:39:49.921828 1193 ts_tablet_manager.cc:1397] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:39:49.923502 1196 tablet_bootstrap.cc:654] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:49.924481 1196 log.cc:824] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:49.926856 1196 tablet_bootstrap.cc:492] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: No bootstrap required, opened a new log
I20260810 18:39:49.927115 1196 ts_tablet_manager.cc:1397] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20260810 18:39:49.929644 1192 raft_consensus.cc:348] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.930207 1192 raft_consensus.cc:374] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:49.930353 1192 raft_consensus.cc:729] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9138070a5de44d02889e5dc26da54170, State: Initialized, Role: FOLLOWER
I20260810 18:39:49.931149 1192 consensus_queue.cc:260] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.932968 1193 raft_consensus.cc:348] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.933506 1193 raft_consensus.cc:374] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:49.933624 1193 raft_consensus.cc:729] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fdbb82233724695bb7fdb84d642b388, State: Initialized, Role: FOLLOWER
I20260810 18:39:49.934343 1193 consensus_queue.cc:260] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.936487 1196 raft_consensus.cc:348] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.937101 1196 raft_consensus.cc:374] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:49.937269 1196 raft_consensus.cc:729] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c819fdccef4e9caf9ff7afdaf6312e, State: Initialized, Role: FOLLOWER
I20260810 18:39:49.938150 1196 consensus_queue.cc:260] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.938637 1172 heartbeater.cc:503] Master 127.13.139.62:37867 was elected leader, sending a full tablet report...
I20260810 18:39:49.939625 1193 ts_tablet_manager.cc:1428] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Time spent starting tablet: real 0.018s user 0.015s sys 0.004s
I20260810 18:39:49.940284 1199 raft_consensus.cc:482] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:49.940528 1199 raft_consensus.cc:504] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.941573 1192 ts_tablet_manager.cc:1428] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Time spent starting tablet: real 0.023s user 0.011s sys 0.008s
I20260810 18:39:49.941952 1020 heartbeater.cc:503] Master 127.13.139.62:37867 was elected leader, sending a full tablet report...
I20260810 18:39:49.942512 1199 leader_election.cc:288] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fdbb82233724695bb7fdb84d642b388 (127.13.139.3:39563), d3c819fdccef4e9caf9ff7afdaf6312e (127.13.139.1:43009)
I20260810 18:39:49.949165 1196 ts_tablet_manager.cc:1428] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Time spent starting tablet: real 0.022s user 0.014s sys 0.007s
I20260810 18:39:49.957227 1189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.943110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:40427 (local address 127.13.139.3:39563)
0810 18:39:49.944025 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.944035 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.949965 (+ 5930us) server_negotiation.cc:407] Connection header received
0810 18:39:49.950275 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.950281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.950356 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.950434 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:49.951557 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.952748 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.955138 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.956377 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.956509 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.956560 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.956958 (+ 398us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.957044 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303}
I20260810 18:39:49.957461 1203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.943109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:39563 (local address 127.13.139.2:40427)
0810 18:39:49.949856 (+ 6747us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:49.949878 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:49.950083 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:49.950842 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:49.950849 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:49.950876 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:49.951349 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.951362 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.953069 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.953074 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.954974 (+ 1900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.954986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.956592 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.956600 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.956783 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.956818 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:39:49.956928 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 18:39:49.957057 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6586,"mutex_wait_us":1,"thread_start_us":6472,"threads_started":1}
I20260810 18:39:49.958516 1204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.950035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:43009 (local address 127.13.139.2:38195)
0810 18:39:49.952019 (+ 1984us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:49.952037 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:49.952155 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:49.952495 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:49.952499 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:49.952578 (+ 79us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:49.952868 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.952876 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.954339 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.954343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.956218 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:49.956232 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.957894 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.957901 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:49.958086 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.958119 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 18:39:49.958201 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 18:39:49.958283 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1869,"thread_start_us":1661,"threads_started":1}
I20260810 18:39:49.958629 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.950253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:38195 (local address 127.13.139.1:43009)
0810 18:39:49.950718 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.950723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.952131 (+ 1408us) server_negotiation.cc:407] Connection header received
0810 18:39:49.952278 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.952283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.952360 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.952480 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:49.953041 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.954201 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.956367 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.957680 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.957844 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.957893 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.958260 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.958391 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321}
I20260810 18:39:49.958583 1123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a6fa7083044cb48a92aac2131c683c" candidate_uuid: "9138070a5de44d02889e5dc26da54170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fdbb82233724695bb7fdb84d642b388" is_pre_election: true
I20260810 18:39:49.959182 1123 raft_consensus.cc:2454] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9138070a5de44d02889e5dc26da54170 in term 0.
I20260810 18:39:49.959635 815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a6fa7083044cb48a92aac2131c683c" candidate_uuid: "9138070a5de44d02889e5dc26da54170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" is_pre_election: true
I20260810 18:39:49.959969 898 leader_election.cc:302] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9138070a5de44d02889e5dc26da54170, 9fdbb82233724695bb7fdb84d642b388; no voters:
I20260810 18:39:49.960213 815 raft_consensus.cc:2454] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9138070a5de44d02889e5dc26da54170 in term 0.
I20260810 18:39:49.960469 1198 raft_consensus.cc:2781] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:39:49.960619 1198 raft_consensus.cc:482] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:39:49.960785 1198 raft_consensus.cc:3037] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 0 FOLLOWER]: Advancing to term 1
W20260810 18:39:49.960815 870 tablet.cc:2369] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:39:49.963480 1198 raft_consensus.cc:504] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.964174 1198 leader_election.cc:288] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [CANDIDATE]: Term 1 election: Requested vote from peers 9fdbb82233724695bb7fdb84d642b388 (127.13.139.3:39563), d3c819fdccef4e9caf9ff7afdaf6312e (127.13.139.1:43009)
I20260810 18:39:49.964597 1123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a6fa7083044cb48a92aac2131c683c" candidate_uuid: "9138070a5de44d02889e5dc26da54170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fdbb82233724695bb7fdb84d642b388"
I20260810 18:39:49.964660 815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a6fa7083044cb48a92aac2131c683c" candidate_uuid: "9138070a5de44d02889e5dc26da54170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e"
I20260810 18:39:49.964761 1123 raft_consensus.cc:3037] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:49.964885 815 raft_consensus.cc:3037] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:49.967039 815 raft_consensus.cc:2454] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9138070a5de44d02889e5dc26da54170 in term 1.
I20260810 18:39:49.967052 1123 raft_consensus.cc:2454] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9138070a5de44d02889e5dc26da54170 in term 1.
I20260810 18:39:49.967473 898 leader_election.cc:302] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9138070a5de44d02889e5dc26da54170, d3c819fdccef4e9caf9ff7afdaf6312e; no voters:
I20260810 18:39:49.967777 1198 raft_consensus.cc:2781] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:49.968017 1198 raft_consensus.cc:686] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 1 LEADER]: Becoming Leader. State: Replica: 9138070a5de44d02889e5dc26da54170, State: Running, Role: LEADER
I20260810 18:39:49.968482 1198 consensus_queue.cc:237] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } }
I20260810 18:39:49.972980 658 catalog_manager.cc:5495] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9138070a5de44d02889e5dc26da54170 (127.13.139.2). New cstate: current_term: 1 leader_uuid: "9138070a5de44d02889e5dc26da54170" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9138070a5de44d02889e5dc26da54170" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 39363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 } health_report { overall_health: UNKNOWN } } }
W20260810 18:39:49.990835 1021 tablet.cc:2369] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:39:49.992976 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:49.987027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57154 (local address 127.13.139.2:39363)
0810 18:39:49.987253 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:49.987259 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:49.987482 (+ 223us) server_negotiation.cc:407] Connection header received
0810 18:39:49.987759 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:49.987763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:49.987843 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:49.988013 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:39:49.988451 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.989190 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.990647 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:49.991166 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:49.991301 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:49.991925 (+ 624us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:39:49.992381 (+ 456us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:39:49.992542 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:49.992623 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 18:39:49.992713 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:39:50.000937 815 raft_consensus.cc:1261] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 1 FOLLOWER]: Refusing update from remote peer 9138070a5de44d02889e5dc26da54170: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:39:50.000986 1123 raft_consensus.cc:1261] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 1 FOLLOWER]: Refusing update from remote peer 9138070a5de44d02889e5dc26da54170: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:39:50.001927 1199 consensus_queue.cc:1035] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fdbb82233724695bb7fdb84d642b388" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:39:50.002240 1198 consensus_queue.cc:1035] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3c819fdccef4e9caf9ff7afdaf6312e" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 43009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:39:50.031256 657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:50.031634 657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:50.035614 657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbd244714dd247e28333e37c5e486500: Sending DeleteTablet for 3 replicas of tablet a2a6fa7083044cb48a92aac2131c683c
I20260810 18:39:50.036806 1099 tablet_service.cc:1514] Processing DeleteTablet for tablet a2a6fa7083044cb48a92aac2131c683c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:50 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:36698
I20260810 18:39:50.036849 794 tablet_service.cc:1514] Processing DeleteTablet for tablet a2a6fa7083044cb48a92aac2131c683c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:50 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:40004
I20260810 18:39:50.037119 948 tablet_service.cc:1514] Processing DeleteTablet for tablet a2a6fa7083044cb48a92aac2131c683c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:50 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:57148
I20260810 18:39:50.038745 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 724
I20260810 18:39:50.048044 1218 tablet_replica.cc:330] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: stopping tablet replica
I20260810 18:39:50.048586 1218 raft_consensus.cc:2229] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:50.048986 1219 tablet_replica.cc:330] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: stopping tablet replica
I20260810 18:39:50.049151 1218 raft_consensus.cc:2258] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:50.049376 1219 raft_consensus.cc:2229] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:39:50.049892 1217 tablet_replica.cc:330] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: stopping tablet replica
I20260810 18:39:50.050243 1219 raft_consensus.cc:2258] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:50.050299 1217 raft_consensus.cc:2229] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:50.050797 1217 raft_consensus.cc:2258] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:50.052444 1219 ts_tablet_manager.cc:1905] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:50.052858 1218 ts_tablet_manager.cc:1905] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:50.054467 1217 ts_tablet_manager.cc:1905] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:50.059787 1218 ts_tablet_manager.cc:1918] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:50.059938 1219 ts_tablet_manager.cc:1918] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:50.060024 1218 log.cc:1196] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/a2a6fa7083044cb48a92aac2131c683c
I20260810 18:39:50.060163 1219 log.cc:1196] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/a2a6fa7083044cb48a92aac2131c683c
I20260810 18:39:50.060726 1218 ts_tablet_manager.cc:1939] T a2a6fa7083044cb48a92aac2131c683c P 9fdbb82233724695bb7fdb84d642b388: Deleting consensus metadata
I20260810 18:39:50.060732 1219 ts_tablet_manager.cc:1939] T a2a6fa7083044cb48a92aac2131c683c P 9138070a5de44d02889e5dc26da54170: Deleting consensus metadata
I20260810 18:39:50.062511 644 catalog_manager.cc:4841] TS 9fdbb82233724695bb7fdb84d642b388 (127.13.139.3:39563): tablet a2a6fa7083044cb48a92aac2131c683c (table test-table [id=62d6da201acc4485aebab36d79f25705]) successfully deleted
I20260810 18:39:50.062852 642 catalog_manager.cc:4841] TS 9138070a5de44d02889e5dc26da54170 (127.13.139.2:39363): tablet a2a6fa7083044cb48a92aac2131c683c (table test-table [id=62d6da201acc4485aebab36d79f25705]) successfully deleted
I20260810 18:39:50.064615 1217 ts_tablet_manager.cc:1918] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:50.064798 1217 log.cc:1196] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/a2a6fa7083044cb48a92aac2131c683c
I20260810 18:39:50.065411 1217 ts_tablet_manager.cc:1939] T a2a6fa7083044cb48a92aac2131c683c P d3c819fdccef4e9caf9ff7afdaf6312e: Deleting consensus metadata
I20260810 18:39:50.067556 644 catalog_manager.cc:4841] TS d3c819fdccef4e9caf9ff7afdaf6312e (127.13.139.1:43009): tablet a2a6fa7083044cb48a92aac2131c683c (table test-table [id=62d6da201acc4485aebab36d79f25705]) successfully deleted
Aug 10 18:39:50 dist-test-slave-5k54 krb5kdc[610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:39:50.078375 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:50.039753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40018 (local address 127.13.139.1:43009)
0810 18:39:50.039995 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:50.040004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:50.051924 (+ 11920us) server_negotiation.cc:407] Connection header received
0810 18:39:50.052258 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:50.052264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:50.052366 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:50.052455 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:50.061320 (+ 8865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:50.062468 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:50.064520 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:50.065278 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:50.065444 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:50.071260 (+ 5816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:50.071277 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:50.071295 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:50.071339 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:50.075196 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:50.076066 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:50.076076 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:50.076080 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:50.076248 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:50.076689 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:50.076695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:50.076698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:50.077164 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:50.077474 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:50.077768 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 18:39:50.078000 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:39:50.079454 863 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:50.184599 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 724
I20260810 18:39:50.205917 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 875
Aug 10 18:39:50 dist-test-slave-5k54 krb5kdc[610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:39:50.224319 1188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:50.206903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57164 (local address 127.13.139.2:39363)
0810 18:39:50.207118 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:50.207125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:50.207146 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:39:50.207210 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:50.207216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:50.207297 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:50.207406 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:50.208782 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:50.210077 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:50.211566 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:50.212284 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:50.212411 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:50.217180 (+ 4769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:50.217200 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:50.217220 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:50.217261 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:50.221243 (+ 3982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:50.221968 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:50.221979 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:50.221983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:50.222171 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:50.222533 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:50.222538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:50.222542 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:50.223011 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:50.223339 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:50.223686 (+ 347us) server_negotiation.cc:299] Negotiation successful
0810 18:39:50.223952 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:39:50.225064 1015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:50.340142 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 875
I20260810 18:39:50.361232 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 1026
Aug 10 18:39:50 dist-test-slave-5k54 krb5kdc[610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:39:50.377033 1189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:50.362016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.13.139.3:39563)
0810 18:39:50.362230 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:50.362236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:50.362256 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:39:50.362392 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:50.362396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:50.362472 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:50.362582 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:50.363981 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:50.364710 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:50.366065 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:50.366464 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:50.366605 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:50.371211 (+ 4606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:50.371225 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:50.371240 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:50.371275 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:50.374023 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:50.374737 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:50.374745 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:50.374747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:50.374879 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:50.375277 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:50.375283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:50.375286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:50.375774 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:50.376117 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:50.376446 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 18:39:50.376694 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 18:39:50.377686 1166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:50.469448 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 1026
I20260810 18:39:50.489319 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 623
I20260810 18:39:50.490543 691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:50.602247 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 623
2026-08-10T18:39:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4477 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T18:39:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:39:50Z Disabled control of system clock
I20260810 18:39:50.694041 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:40933
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:40933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 18:39:51.036033 1228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:51.036330 1228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:51.036417 1228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:51.043592 1228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:39:51.043699 1228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:51.043736 1228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:51.043797 1228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:39:51.043843 1228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:39:51.052977 1228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:40933
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:40933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:51.054211 1228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:51.055964 1228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:51.067859 1234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:51.067818 1237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:51.067915 1235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:51.068703 1228 server_base.cc:1034] running on GCE node
I20260810 18:39:51.069445 1228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:51.070794 1228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:51.072026 1228 hybrid_clock.cc:648] HybridClock initialized: now 1786387191071958 us; error 56 us; skew 500 ppm
I20260810 18:39:51.072424 1228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:39:51.074973 1228 webserver.cc:460] Webserver started at http://127.13.139.62:45023/ using document root <none> and password file <none>
I20260810 18:39:51.075790 1228 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:51.075928 1228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:51.076262 1228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:51.079236 1228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "6c2db144946b45358440b0c21f145d8e"
format_stamp: "Formatted at 2026-08-10 18:39:51 on dist-test-slave-5k54"
server_key: "a87c073cb7387a2f40680939b103d90a"
server_key_iv: "448b6f458e0e699d0b6f327b5c899f23"
server_key_version: "encryptionkey@0"
I20260810 18:39:51.080129 1228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "6c2db144946b45358440b0c21f145d8e"
format_stamp: "Formatted at 2026-08-10 18:39:51 on dist-test-slave-5k54"
server_key: "a87c073cb7387a2f40680939b103d90a"
server_key_iv: "448b6f458e0e699d0b6f327b5c899f23"
server_key_version: "encryptionkey@0"
I20260810 18:39:51.085502 1228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:39:51.089130 1243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:51.090524 1228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:39:51.090724 1228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "6c2db144946b45358440b0c21f145d8e"
format_stamp: "Formatted at 2026-08-10 18:39:51 on dist-test-slave-5k54"
server_key: "a87c073cb7387a2f40680939b103d90a"
server_key_iv: "448b6f458e0e699d0b6f327b5c899f23"
server_key_version: "encryptionkey@0"
I20260810 18:39:51.090955 1228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:51.116016 1228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:51.116887 1228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:51.117203 1228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:51.136000 1228 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:40933
I20260810 18:39:51.136089 1301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:40933 every 8 connection(s)
I20260810 18:39:51.137342 1228 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:39:51.141361 1302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:51.142783 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 1228
I20260810 18:39:51.142970 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:39:51.143559 13868 external_mini_cluster.cc:1428] Setting key 82562d169d1250056a4223139b29f320
I20260810 18:39:51.154104 1302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e: Bootstrap starting.
I20260810 18:39:51.156716 1305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:51.145507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58032 (local address 127.13.139.62:40933)
0810 18:39:51.146505 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:51.146518 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:51.146558 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:39:51.148182 (+ 1624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:51.148202 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:51.148686 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:51.149075 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:51.149615 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:51.150936 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:51.152411 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:51.153060 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:51.153268 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:51.154550 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:51.154558 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:51.154571 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:51.155100 (+ 529us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:51.155174 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:51.155194 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:51.155335 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:51.155581 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 18:39:51.155867 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":378,"threads_started":1}
I20260810 18:39:51.157449 1302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:51.158515 1302 log.cc:824] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:51.161221 1302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e: No bootstrap required, opened a new log
I20260810 18:39:51.168493 1302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2db144946b45358440b0c21f145d8e" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40933 } }
I20260810 18:39:51.168853 1302 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:51.168967 1302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c2db144946b45358440b0c21f145d8e, State: Initialized, Role: FOLLOWER
I20260810 18:39:51.169538 1302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2db144946b45358440b0c21f145d8e" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40933 } }
I20260810 18:39:51.169783 1302 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:39:51.169934 1302 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:39:51.170104 1302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:51.172523 1302 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2db144946b45358440b0c21f145d8e" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40933 } }
I20260810 18:39:51.173026 1302 leader_election.cc:302] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c2db144946b45358440b0c21f145d8e; no voters:
I20260810 18:39:51.173625 1302 leader_election.cc:288] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:39:51.173779 1307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:51.174501 1307 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [term 1 LEADER]: Becoming Leader. State: Replica: 6c2db144946b45358440b0c21f145d8e, State: Running, Role: LEADER
I20260810 18:39:51.174979 1307 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2db144946b45358440b0c21f145d8e" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40933 } }
I20260810 18:39:51.175674 1302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:39:51.177779 1309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c2db144946b45358440b0c21f145d8e. Latest consensus state: current_term: 1 leader_uuid: "6c2db144946b45358440b0c21f145d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2db144946b45358440b0c21f145d8e" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40933 } } }
I20260810 18:39:51.178210 1309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:51.180222 1308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c2db144946b45358440b0c21f145d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c2db144946b45358440b0c21f145d8e" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 40933 } } }
I20260810 18:39:51.180630 1308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:51.181262 1316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:39:51.185828 1316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:39:51.194590 1316 catalog_manager.cc:1347] Generated new cluster ID: aa2c712912564b7ba42bb647fb917329
I20260810 18:39:51.194716 1316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:39:51.207266 1316 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:39:51.208520 1316 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:39:51.217751 1316 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e: Generated new TSK 0
I20260810 18:39:51.218549 1316 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:39:51.226464 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40933
--builtin_ntp_servers=127.13.139.20:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 18:39:51.567219 1329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:51.567618 1329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:51.567788 1329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:51.575081 1329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:51.575225 1329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:51.575407 1329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:39:51.584733 1329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:51.586061 1329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:51.587962 1329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:51.601446 1336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:51.601477 1334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:51.601526 1338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:51.602300 1329 server_base.cc:1034] running on GCE node
I20260810 18:39:51.602907 1329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:51.603945 1329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:51.605187 1329 hybrid_clock.cc:648] HybridClock initialized: now 1786387191605145 us; error 54 us; skew 500 ppm
I20260810 18:39:51.605511 1329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:39:51.607744 1329 webserver.cc:460] Webserver started at http://127.13.139.1:36739/ using document root <none> and password file <none>
I20260810 18:39:51.608430 1329 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:51.608570 1329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:51.608893 1329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:51.611752 1329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "b94d03e4836749999f8d5cb09f012262"
format_stamp: "Formatted at 2026-08-10 18:39:51 on dist-test-slave-5k54"
server_key: "a84ae8c5427e150f017c597a3f2fbf36"
server_key_iv: "d26bfdfb91276cb51c3b069a6052de73"
server_key_version: "encryptionkey@0"
I20260810 18:39:51.612553 1329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "b94d03e4836749999f8d5cb09f012262"
format_stamp: "Formatted at 2026-08-10 18:39:51 on dist-test-slave-5k54"
server_key: "a84ae8c5427e150f017c597a3f2fbf36"
server_key_iv: "d26bfdfb91276cb51c3b069a6052de73"
server_key_version: "encryptionkey@0"
I20260810 18:39:51.617451 1329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:39:51.620795 1345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:51.622020 1329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260810 18:39:51.622198 1329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "b94d03e4836749999f8d5cb09f012262"
format_stamp: "Formatted at 2026-08-10 18:39:51 on dist-test-slave-5k54"
server_key: "a84ae8c5427e150f017c597a3f2fbf36"
server_key_iv: "d26bfdfb91276cb51c3b069a6052de73"
server_key_version: "encryptionkey@0"
I20260810 18:39:51.622413 1329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:51.639544 1329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:51.640323 1329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:51.640635 1329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:51.641573 1329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:51.643129 1329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:51.643283 1329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:51.643457 1329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:51.643551 1329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260810 18:39:51.677860 1329 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:42913
I20260810 18:39:51.677947 1471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:42913 every 8 connection(s)
I20260810 18:39:51.679191 1329 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:39:51.686833 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 1329
I20260810 18:39:51.687037 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:39:51.687624 13868 external_mini_cluster.cc:1428] Setting key 8260c2ef68543f252b5673501505951c
I20260810 18:39:51.690558 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40933
--builtin_ntp_servers=127.13.139.20:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 18:39:51.692744 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:51.681984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:51467 (local address 127.13.139.62:40933)
0810 18:39:51.682450 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:51.682456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:51.683658 (+ 1202us) server_negotiation.cc:407] Connection header received
0810 18:39:51.685448 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:51.685452 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:51.685520 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:51.685615 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:51.686679 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:51.687785 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:51.689638 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:51.690077 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:51.690231 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:51.691789 (+ 1558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:51.691795 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:51.691799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:51.691820 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:51.691926 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:51.691950 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:51.692085 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:51.692318 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 18:39:51.692415 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":210,"threads_started":1}
I20260810 18:39:51.693754 1475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:51.682539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:40933 (local address 127.13.139.1:51467)
0810 18:39:51.683500 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:51.683554 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:51.685206 (+ 1652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:51.685848 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:51.685856 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:51.685939 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:51.686501 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:51.686517 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:51.687933 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:51.687937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:51.689482 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:51.689494 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:51.690321 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:51.690330 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:51.690616 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:51.691471 (+ 855us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:39:51.691475 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:51.691522 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:39:51.691597 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:51.692086 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:51.692101 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:51.692111 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 18:39:51.692297 (+ 186us) client_negotiation.cc:240] Negotiation successful
0810 18:39:51.692678 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":298,"threads_started":1}
I20260810 18:39:51.695231 1472 heartbeater.cc:347] Connected to a master server at 127.13.139.62:40933
I20260810 18:39:51.695597 1472 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:51.696501 1472 heartbeater.cc:511] Master 127.13.139.62:40933 requested a full tablet report, sending...
I20260810 18:39:51.698613 1263 ts_manager.cc:194] Registered new tserver with Master: b94d03e4836749999f8d5cb09f012262 (127.13.139.1:42913)
I20260810 18:39:51.700130 1263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.1:51467
W20260810 18:39:52.022970 1476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:52.023239 1476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:52.023382 1476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:52.030628 1476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:52.030720 1476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:52.030916 1476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:39:52.039773 1476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:52.041034 1476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:52.042831 1476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:52.056164 1481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:52.056186 1484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:52.056231 1482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:52.057078 1476 server_base.cc:1034] running on GCE node
I20260810 18:39:52.057658 1476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:52.058557 1476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:52.059805 1476 hybrid_clock.cc:648] HybridClock initialized: now 1786387192059758 us; error 61 us; skew 500 ppm
I20260810 18:39:52.060113 1476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:39:52.062245 1476 webserver.cc:460] Webserver started at http://127.13.139.2:40007/ using document root <none> and password file <none>
I20260810 18:39:52.062938 1476 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:52.063071 1476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:52.063396 1476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:52.066238 1476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "256cfeac6fd448159c4dcf2b7b698ac9"
format_stamp: "Formatted at 2026-08-10 18:39:52 on dist-test-slave-5k54"
server_key: "ba3c760436d6c58feea8dd5bec56635c"
server_key_iv: "3d777207038c464815e09040258f1134"
server_key_version: "encryptionkey@0"
I20260810 18:39:52.067028 1476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "256cfeac6fd448159c4dcf2b7b698ac9"
format_stamp: "Formatted at 2026-08-10 18:39:52 on dist-test-slave-5k54"
server_key: "ba3c760436d6c58feea8dd5bec56635c"
server_key_iv: "3d777207038c464815e09040258f1134"
server_key_version: "encryptionkey@0"
I20260810 18:39:52.072046 1476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 18:39:52.075399 1490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:52.076836 1476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:39:52.077028 1476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "256cfeac6fd448159c4dcf2b7b698ac9"
format_stamp: "Formatted at 2026-08-10 18:39:52 on dist-test-slave-5k54"
server_key: "ba3c760436d6c58feea8dd5bec56635c"
server_key_iv: "3d777207038c464815e09040258f1134"
server_key_version: "encryptionkey@0"
I20260810 18:39:52.077242 1476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:52.100601 1476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:52.101490 1476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:52.101826 1476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:52.102850 1476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:52.104480 1476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:52.104612 1476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:52.104748 1476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:52.104856 1476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:52.138509 1476 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:36779
I20260810 18:39:52.138569 1616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:36779 every 8 connection(s)
I20260810 18:39:52.140100 1476 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:39:52.141198 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 1476
I20260810 18:39:52.141389 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:39:52.141973 13868 external_mini_cluster.cc:1428] Setting key 90165c2e1cfcefa5c482f771c67c4976
I20260810 18:39:52.146015 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40933
--builtin_ntp_servers=127.13.139.20:43277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 18:39:52.162850 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.143678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:34337 (local address 127.13.139.62:40933)
0810 18:39:52.143864 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:52.143871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:52.145697 (+ 1826us) server_negotiation.cc:407] Connection header received
0810 18:39:52.148818 (+ 3121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:52.148825 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:52.148916 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:52.148992 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:52.155946 (+ 6954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.157114 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.159706 (+ 2592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.160362 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.160514 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.162023 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:52.162029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:52.162033 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:52.162074 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:52.162104 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:52.162117 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:52.162221 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:52.162447 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 18:39:52.162546 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:39:52.163915 1619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.144420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:40933 (local address 127.13.139.2:34337)
0810 18:39:52.145533 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:52.145592 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:52.148454 (+ 2862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:52.149559 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:52.149573 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:52.149697 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:52.155722 (+ 6025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.155749 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.157346 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.157353 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.159523 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.159542 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.160619 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.160629 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.160937 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.161697 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:39:52.161699 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:52.161736 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:39:52.161815 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:52.162222 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:52.162235 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:52.162245 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 18:39:52.162420 (+ 175us) client_negotiation.cc:240] Negotiation successful
0810 18:39:52.162808 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":10954,"threads_started":1}
I20260810 18:39:52.165408 1617 heartbeater.cc:347] Connected to a master server at 127.13.139.62:40933
I20260810 18:39:52.165709 1617 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:52.166419 1617 heartbeater.cc:511] Master 127.13.139.62:40933 requested a full tablet report, sending...
I20260810 18:39:52.167862 1263 ts_manager.cc:194] Registered new tserver with Master: 256cfeac6fd448159c4dcf2b7b698ac9 (127.13.139.2:36779)
I20260810 18:39:52.168684 1263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.2:34337
W20260810 18:39:52.484359 1620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:52.484624 1620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:52.484761 1620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:52.492039 1620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:52.492133 1620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:52.492336 1620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:39:52.501309 1620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:43277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:40933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:52.502616 1620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:52.504379 1620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:52.517602 1625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:52.517709 1626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:52.517673 1628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:52.519215 1620 server_base.cc:1034] running on GCE node
I20260810 18:39:52.519877 1620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:52.520882 1620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:52.522089 1620 hybrid_clock.cc:648] HybridClock initialized: now 1786387192522047 us; error 31 us; skew 500 ppm
I20260810 18:39:52.522418 1620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:39:52.524832 1620 webserver.cc:460] Webserver started at http://127.13.139.3:32987/ using document root <none> and password file <none>
I20260810 18:39:52.525574 1620 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:52.525691 1620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:52.526029 1620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:52.529070 1620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "369166cf4c5c4bb3b1771580b6d3dbeb"
format_stamp: "Formatted at 2026-08-10 18:39:52 on dist-test-slave-5k54"
server_key: "c41ef0a0b4d8518d86968a17afd60d94"
server_key_iv: "99182bf63dc9225c894b93f9faf5df21"
server_key_version: "encryptionkey@0"
I20260810 18:39:52.529819 1620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "369166cf4c5c4bb3b1771580b6d3dbeb"
format_stamp: "Formatted at 2026-08-10 18:39:52 on dist-test-slave-5k54"
server_key: "c41ef0a0b4d8518d86968a17afd60d94"
server_key_iv: "99182bf63dc9225c894b93f9faf5df21"
server_key_version: "encryptionkey@0"
I20260810 18:39:52.534992 1620 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 18:39:52.538525 1634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:52.539994 1620 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:52.540130 1620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "369166cf4c5c4bb3b1771580b6d3dbeb"
format_stamp: "Formatted at 2026-08-10 18:39:52 on dist-test-slave-5k54"
server_key: "c41ef0a0b4d8518d86968a17afd60d94"
server_key_iv: "99182bf63dc9225c894b93f9faf5df21"
server_key_version: "encryptionkey@0"
I20260810 18:39:52.540310 1620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:52.559675 1620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:52.560406 1620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:52.560662 1620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:52.561524 1620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:52.562844 1620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:52.562928 1620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:52.563021 1620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:52.563076 1620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:52.597543 1620 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:45103
I20260810 18:39:52.597637 1761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:45103 every 8 connection(s)
I20260810 18:39:52.598856 1620 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:39:52.600186 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 1620
I20260810 18:39:52.600406 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:39:52.601063 13868 external_mini_cluster.cc:1428] Setting key ee34da8a9ef27ba7acbca03d85fc27be
I20260810 18:39:52.612214 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.601924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:43487 (local address 127.13.139.62:40933)
0810 18:39:52.602138 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:52.602146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:52.603979 (+ 1833us) server_negotiation.cc:407] Connection header received
0810 18:39:52.605803 (+ 1824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:52.605809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:52.605906 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:52.606021 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:52.607041 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.607834 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.609461 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.609869 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.610015 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.611335 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:52.611340 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:52.611343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:52.611361 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:52.611394 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:52.611407 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:52.611531 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:52.611756 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 18:39:52.611849 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 18:39:52.613113 1765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.602721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:40933 (local address 127.13.139.3:43487)
0810 18:39:52.603827 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:52.603866 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:52.605548 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:52.606248 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:52.606256 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:52.606339 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:52.606877 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.606894 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.608000 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.608004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.609297 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.609309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.610095 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.610102 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.610324 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.611022 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:39:52.611025 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:52.611060 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:39:52.611133 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:52.611531 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:52.611545 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:52.611555 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 18:39:52.611745 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 18:39:52.612112 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":359,"threads_started":1}
I20260810 18:39:52.614315 1763 heartbeater.cc:347] Connected to a master server at 127.13.139.62:40933
I20260810 18:39:52.614655 1763 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:52.615618 1763 heartbeater.cc:511] Master 127.13.139.62:40933 requested a full tablet report, sending...
I20260810 18:39:52.617071 1263 ts_manager.cc:194] Registered new tserver with Master: 369166cf4c5c4bb3b1771580b6d3dbeb (127.13.139.3:45103)
I20260810 18:39:52.617774 1263 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.3:43487
I20260810 18:39:52.629007 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:39:52.638965 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.633238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58046 (local address 127.13.139.62:40933)
0810 18:39:52.633456 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:52.633461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:52.633840 (+ 379us) server_negotiation.cc:407] Connection header received
0810 18:39:52.633979 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:52.633983 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:52.634058 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:52.634153 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:52.634623 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.635356 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.636797 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.637218 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.637322 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.638348 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:52.638354 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:52.638357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:52.638377 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:52.638427 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:52.638440 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:52.638516 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:52.638640 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 18:39:52.638716 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:39:52.642678 1263 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:39:52.649835 1263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:39:52.686890 1775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.661736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58194)
0810 18:39:52.674784 (+ 13048us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:52.674851 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:52.675087 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:52.677364 (+ 2277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:52.677376 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:52.677418 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:52.677920 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.677936 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.680607 (+ 2671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.680615 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.683242 (+ 2627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.683256 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.685881 (+ 2625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.685888 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.686112 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.686168 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 18:39:52.686295 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 18:39:52.686534 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12691,"thread_start_us":12539,"threads_started":1}
I20260810 18:39:52.686949 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.662552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58194 (local address 127.13.139.1:42913)
0810 18:39:52.676147 (+ 13595us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:52.676160 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:52.676200 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:39:52.676320 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:52.676330 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:52.676732 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:52.676994 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:52.678185 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.680406 (+ 2221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.683523 (+ 3117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.685234 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.685385 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.685716 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:52.686384 (+ 668us) server_negotiation.cc:299] Negotiation successful
0810 18:39:52.686584 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13390,"thread_start_us":13254,"threads_started":1}
I20260810 18:39:52.689841 1781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.676247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:36779 (local address 127.0.0.1:58474)
0810 18:39:52.681091 (+ 4844us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:52.681109 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:52.681257 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:52.682106 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:52.682111 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:52.682136 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:52.682552 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.682562 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.684734 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.684739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.687092 (+ 2353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.687108 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.689021 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.689028 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.689198 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.689239 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 18:39:52.689348 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 18:39:52.689477 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4703,"mutex_wait_us":113,"thread_start_us":4523,"threads_started":1}
I20260810 18:39:52.689963 1780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.675781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58474 (local address 127.13.139.2:36779)
0810 18:39:52.680676 (+ 4895us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:52.680686 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:52.681406 (+ 720us) server_negotiation.cc:407] Connection header received
0810 18:39:52.681519 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:52.681527 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:52.681892 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:52.682760 (+ 868us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:52.682991 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.684573 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.687311 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.688806 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.688953 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.689178 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:52.689404 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 18:39:52.689578 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4734,"thread_start_us":4606,"threads_started":1}
I20260810 18:39:52.690474 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.662869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47464 (local address 127.13.139.3:45103)
0810 18:39:52.673334 (+ 10465us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:52.673344 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:52.676099 (+ 2755us) server_negotiation.cc:407] Connection header received
0810 18:39:52.676207 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:52.676216 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:52.676539 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:52.676778 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:52.682085 (+ 5307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.684727 (+ 2642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.687453 (+ 2726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.688806 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.688957 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.689213 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:52.689944 (+ 731us) server_negotiation.cc:299] Negotiation successful
0810 18:39:52.690133 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10254,"thread_start_us":10919,"threads_started":1}
I20260810 18:39:52.690812 1776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:52.662108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:45103 (local address 127.0.0.1:47464)
0810 18:39:52.675854 (+ 13746us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:52.675874 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:52.676028 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:52.681021 (+ 4993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:52.681027 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:52.681053 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:52.681620 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.681635 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.684965 (+ 3330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.684970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.687185 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:52.687203 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:52.689362 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:52.689369 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:52.689558 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:52.689590 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 18:39:52.689682 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 18:39:52.689820 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13570,"mutex_wait_us":64,"thread_start_us":13359,"threads_started":1}
I20260810 18:39:52.691335 1396 tablet_service.cc:1467] Processing CreateTablet for tablet 83212701c9024281bd82ae5e9f7f4693 (DEFAULT_TABLE table=test-table [id=38be56ab7b0a4da4b55647646d822782]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:52.692991 1396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83212701c9024281bd82ae5e9f7f4693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:52.694226 1685 tablet_service.cc:1467] Processing CreateTablet for tablet 83212701c9024281bd82ae5e9f7f4693 (DEFAULT_TABLE table=test-table [id=38be56ab7b0a4da4b55647646d822782]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:52.694269 1540 tablet_service.cc:1467] Processing CreateTablet for tablet 83212701c9024281bd82ae5e9f7f4693 (DEFAULT_TABLE table=test-table [id=38be56ab7b0a4da4b55647646d822782]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:52.695669 1685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83212701c9024281bd82ae5e9f7f4693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:52.695695 1540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83212701c9024281bd82ae5e9f7f4693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:52.703532 1472 heartbeater.cc:503] Master 127.13.139.62:40933 was elected leader, sending a full tablet report...
I20260810 18:39:52.707995 1782 tablet_bootstrap.cc:492] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Bootstrap starting.
I20260810 18:39:52.710086 1783 tablet_bootstrap.cc:492] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: Bootstrap starting.
I20260810 18:39:52.713328 1782 tablet_bootstrap.cc:654] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:52.713784 1783 tablet_bootstrap.cc:654] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:52.714291 1784 tablet_bootstrap.cc:492] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Bootstrap starting.
I20260810 18:39:52.714705 1782 log.cc:824] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:52.715544 1783 log.cc:824] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:52.718068 1783 tablet_bootstrap.cc:492] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: No bootstrap required, opened a new log
I20260810 18:39:52.718052 1784 tablet_bootstrap.cc:654] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:52.718196 1782 tablet_bootstrap.cc:492] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: No bootstrap required, opened a new log
I20260810 18:39:52.718357 1783 ts_tablet_manager.cc:1397] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 18:39:52.718477 1782 ts_tablet_manager.cc:1397] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260810 18:39:52.719301 1784 log.cc:824] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:52.722337 1784 tablet_bootstrap.cc:492] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: No bootstrap required, opened a new log
I20260810 18:39:52.722596 1784 ts_tablet_manager.cc:1397] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:39:52.726475 1783 raft_consensus.cc:348] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:52.726858 1783 raft_consensus.cc:374] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:52.726998 1783 raft_consensus.cc:729] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94d03e4836749999f8d5cb09f012262, State: Initialized, Role: FOLLOWER
I20260810 18:39:52.727658 1783 consensus_queue.cc:260] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:52.728958 1782 raft_consensus.cc:348] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:52.729409 1782 raft_consensus.cc:374] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:52.729436 1783 ts_tablet_manager.cc:1428] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260810 18:39:52.729517 1782 raft_consensus.cc:729] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369166cf4c5c4bb3b1771580b6d3dbeb, State: Initialized, Role: FOLLOWER
I20260810 18:39:52.730156 1782 consensus_queue.cc:260] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:52.731352 1763 heartbeater.cc:503] Master 127.13.139.62:40933 was elected leader, sending a full tablet report...
I20260810 18:39:52.732102 1782 ts_tablet_manager.cc:1428] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Time spent starting tablet: real 0.013s user 0.007s sys 0.007s
I20260810 18:39:52.733253 1784 raft_consensus.cc:348] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:52.733619 1784 raft_consensus.cc:374] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:52.733742 1784 raft_consensus.cc:729] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256cfeac6fd448159c4dcf2b7b698ac9, State: Initialized, Role: FOLLOWER
I20260810 18:39:52.734366 1784 consensus_queue.cc:260] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:52.735493 1617 heartbeater.cc:503] Master 127.13.139.62:40933 was elected leader, sending a full tablet report...
I20260810 18:39:52.736141 1784 ts_tablet_manager.cc:1428] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
W20260810 18:39:52.850879 1764 tablet.cc:2369] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:39:52.906872 1618 tablet.cc:2369] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:39:52.931723 1473 tablet.cc:2369] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:39:53.039264 1790 raft_consensus.cc:482] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:53.039685 1790 raft_consensus.cc:504] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:53.041363 1790 leader_election.cc:288] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b94d03e4836749999f8d5cb09f012262 (127.13.139.1:42913), 256cfeac6fd448159c4dcf2b7b698ac9 (127.13.139.2:36779)
I20260810 18:39:53.048295 1765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.041709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.13.139.3:56527)
0810 18:39:53.041898 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.041920 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:53.042054 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:53.042552 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:53.042557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:53.042588 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:53.042922 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:53.042939 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.044311 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.044316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:53.046182 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:53.046196 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.047614 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.047620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:53.047834 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.047859 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 18:39:53.047940 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 18:39:53.048039 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":6}
I20260810 18:39:53.048405 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.041782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:56527 (local address 127.13.139.1:42913)
0810 18:39:53.041972 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:53.041976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:53.041997 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:39:53.042250 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:53.042255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:53.042379 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:53.042518 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:53.043178 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.044161 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.046346 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.047449 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.047603 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.047675 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:53.047999 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 18:39:53.048135 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:39:53.049075 1792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.042181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:36779 (local address 127.13.139.3:50235)
0810 18:39:53.043200 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.043220 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:53.043322 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:53.043699 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:53.043703 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:53.043724 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:53.043997 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:53.044004 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.045081 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.045087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:53.046866 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:53.046877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.048370 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.048378 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:53.048590 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.048648 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 18:39:53.048729 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 18:39:53.048810 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":866,"thread_start_us":653,"threads_started":1}
I20260810 18:39:53.049170 1780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.042624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:50235 (local address 127.13.139.2:36779)
0810 18:39:53.042870 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:53.042877 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:53.043314 (+ 437us) server_negotiation.cc:407] Connection header received
0810 18:39:53.043445 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:53.043451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:53.043555 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:53.043656 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:53.044204 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.044928 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.047040 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.048185 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.048329 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.048395 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:53.048791 (+ 396us) server_negotiation.cc:299] Negotiation successful
0810 18:39:53.048941 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 18:39:53.049477 1423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83212701c9024281bd82ae5e9f7f4693" candidate_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94d03e4836749999f8d5cb09f012262" is_pre_election: true
I20260810 18:39:53.050063 1423 raft_consensus.cc:2454] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369166cf4c5c4bb3b1771580b6d3dbeb in term 0.
I20260810 18:39:53.050184 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83212701c9024281bd82ae5e9f7f4693" candidate_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" is_pre_election: true
I20260810 18:39:53.050726 1562 raft_consensus.cc:2454] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 369166cf4c5c4bb3b1771580b6d3dbeb in term 0.
I20260810 18:39:53.050799 1637 leader_election.cc:302] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369166cf4c5c4bb3b1771580b6d3dbeb, b94d03e4836749999f8d5cb09f012262; no voters:
I20260810 18:39:53.051275 1790 raft_consensus.cc:2781] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:39:53.051435 1790 raft_consensus.cc:482] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:39:53.051561 1790 raft_consensus.cc:3037] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:53.053835 1790 raft_consensus.cc:504] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:53.054414 1790 leader_election.cc:288] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [CANDIDATE]: Term 1 election: Requested vote from peers b94d03e4836749999f8d5cb09f012262 (127.13.139.1:42913), 256cfeac6fd448159c4dcf2b7b698ac9 (127.13.139.2:36779)
I20260810 18:39:53.054968 1423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83212701c9024281bd82ae5e9f7f4693" candidate_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b94d03e4836749999f8d5cb09f012262"
I20260810 18:39:53.055058 1562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83212701c9024281bd82ae5e9f7f4693" candidate_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256cfeac6fd448159c4dcf2b7b698ac9"
I20260810 18:39:53.055166 1423 raft_consensus.cc:3037] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:53.055301 1562 raft_consensus.cc:3037] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:53.057404 1423 raft_consensus.cc:2454] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369166cf4c5c4bb3b1771580b6d3dbeb in term 1.
I20260810 18:39:53.057543 1562 raft_consensus.cc:2454] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 369166cf4c5c4bb3b1771580b6d3dbeb in term 1.
I20260810 18:39:53.057791 1637 leader_election.cc:302] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369166cf4c5c4bb3b1771580b6d3dbeb, b94d03e4836749999f8d5cb09f012262; no voters:
I20260810 18:39:53.058146 1790 raft_consensus.cc:2781] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:53.058595 1790 raft_consensus.cc:686] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 1 LEADER]: Becoming Leader. State: Replica: 369166cf4c5c4bb3b1771580b6d3dbeb, State: Running, Role: LEADER
I20260810 18:39:53.059053 1790 consensus_queue.cc:237] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } }
I20260810 18:39:53.063999 1262 catalog_manager.cc:5495] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb reported cstate change: term changed from 0 to 1, leader changed from <none> to 369166cf4c5c4bb3b1771580b6d3dbeb (127.13.139.3). New cstate: current_term: 1 leader_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369166cf4c5c4bb3b1771580b6d3dbeb" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 45103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 } health_report { overall_health: UNKNOWN } } }
I20260810 18:39:53.127517 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.121996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47472 (local address 127.13.139.3:45103)
0810 18:39:53.122178 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:53.122183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:53.122202 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:39:53.122375 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:53.122379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:53.122486 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:53.122611 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:39:53.122976 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.123804 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.125233 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.125642 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.125733 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.126309 (+ 576us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:39:53.126876 (+ 567us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:39:53.126987 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:53.127097 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 18:39:53.127163 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 18:39:53.135772 1562 raft_consensus.cc:1261] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 1 FOLLOWER]: Refusing update from remote peer 369166cf4c5c4bb3b1771580b6d3dbeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:39:53.135772 1423 raft_consensus.cc:1261] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 1 FOLLOWER]: Refusing update from remote peer 369166cf4c5c4bb3b1771580b6d3dbeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:39:53.136889 1793 consensus_queue.cc:1035] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "256cfeac6fd448159c4dcf2b7b698ac9" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:39:53.137295 1790 consensus_queue.cc:1035] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94d03e4836749999f8d5cb09f012262" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:39:53.165138 1796 mvcc.cc:205] Tried to move back new op lower bound from 7317041943073726464 to 7317041942773899264. Current Snapshot: MvccSnapshot[applied={T|T < 7317041943073726464}]
I20260810 18:39:53.168684 1797 mvcc.cc:205] Tried to move back new op lower bound from 7317041943073726464 to 7317041942773899264. Current Snapshot: MvccSnapshot[applied={T|T < 7317041943073726464}]
I20260810 18:39:53.182323 1262 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:53.182622 1262 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:53.186275 1262 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c2db144946b45358440b0c21f145d8e: Sending DeleteTablet for 3 replicas of tablet 83212701c9024281bd82ae5e9f7f4693
I20260810 18:39:53.187321 1396 tablet_service.cc:1514] Processing DeleteTablet for tablet 83212701c9024281bd82ae5e9f7f4693 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:53 UTC) from {username='slave'} at 127.0.0.1:58194
I20260810 18:39:53.187489 1685 tablet_service.cc:1514] Processing DeleteTablet for tablet 83212701c9024281bd82ae5e9f7f4693 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:53 UTC) from {username='slave'} at 127.0.0.1:47464
I20260810 18:39:53.188858 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 1329
I20260810 18:39:53.188843 1540 tablet_service.cc:1514] Processing DeleteTablet for tablet 83212701c9024281bd82ae5e9f7f4693 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:53 UTC) from {username='slave'} at 127.0.0.1:58474
I20260810 18:39:53.205765 1807 tablet_replica.cc:330] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: stopping tablet replica
I20260810 18:39:53.206336 1807 raft_consensus.cc:2229] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:53.208927 1807 raft_consensus.cc:2258] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:53.209625 1810 tablet_replica.cc:330] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: stopping tablet replica
I20260810 18:39:53.210330 1810 raft_consensus.cc:2229] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:53.211030 1810 raft_consensus.cc:2258] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:53.211468 1809 tablet_replica.cc:330] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: stopping tablet replica
I20260810 18:39:53.212196 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.190173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58200 (local address 127.13.139.1:42913)
0810 18:39:53.190344 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:53.190351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:53.200741 (+ 10390us) server_negotiation.cc:407] Connection header received
0810 18:39:53.201209 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:53.201215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:53.201325 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:53.201406 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:53.202093 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.203354 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.206602 (+ 3248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.207260 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.207358 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.209818 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:53.209830 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:53.209849 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:53.210630 (+ 781us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:53.210702 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:53.210727 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:53.210815 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:53.211678 (+ 863us) server_negotiation.cc:299] Negotiation successful
0810 18:39:53.211804 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:39:53.213367 1810 ts_tablet_manager.cc:1905] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:53.213587 1467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:53.213841 1809 raft_consensus.cc:2229] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:39:53.214758 1809 raft_consensus.cc:2258] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:53.216972 1809 ts_tablet_manager.cc:1905] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:53.222586 1810 ts_tablet_manager.cc:1918] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:53.222868 1810 log.cc:1196] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/83212701c9024281bd82ae5e9f7f4693
I20260810 18:39:53.223646 1810 ts_tablet_manager.cc:1939] T 83212701c9024281bd82ae5e9f7f4693 P 256cfeac6fd448159c4dcf2b7b698ac9: Deleting consensus metadata
I20260810 18:39:53.224570 1809 ts_tablet_manager.cc:1918] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:53.224821 1809 log.cc:1196] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/83212701c9024281bd82ae5e9f7f4693
I20260810 18:39:53.225641 1809 ts_tablet_manager.cc:1939] T 83212701c9024281bd82ae5e9f7f4693 P 369166cf4c5c4bb3b1771580b6d3dbeb: Deleting consensus metadata
I20260810 18:39:53.226002 1246 catalog_manager.cc:4841] TS 256cfeac6fd448159c4dcf2b7b698ac9 (127.13.139.2:36779): tablet 83212701c9024281bd82ae5e9f7f4693 (table test-table [id=38be56ab7b0a4da4b55647646d822782]) successfully deleted
I20260810 18:39:53.227367 1244 catalog_manager.cc:4841] TS 369166cf4c5c4bb3b1771580b6d3dbeb (127.13.139.3:45103): tablet 83212701c9024281bd82ae5e9f7f4693 (table test-table [id=38be56ab7b0a4da4b55647646d822782]) successfully deleted
I20260810 18:39:53.219990 1807 ts_tablet_manager.cc:1905] T 83212701c9024281bd82ae5e9f7f4693 P b94d03e4836749999f8d5cb09f012262: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:53.317296 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 1329
W20260810 18:39:53.337785 1246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:42913 (error 108)
I20260810 18:39:53.339130 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 1476
I20260810 18:39:53.340193 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.339074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58208)
0810 18:39:53.339800 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.339949 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":453,"threads_started":1}
W20260810 18:39:53.340487 1246 catalog_manager.cc:4584] TS b94d03e4836749999f8d5cb09f012262 (127.13.139.1:42913): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83212701c9024281bd82ae5e9f7f4693: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
I20260810 18:39:53.348207 1780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.340101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58488 (local address 127.13.139.2:36779)
0810 18:39:53.340274 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:53.340281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:53.340836 (+ 555us) server_negotiation.cc:407] Connection header received
0810 18:39:53.340916 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:53.340921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:53.341033 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:53.341136 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:53.341583 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.342675 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.344529 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.345235 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.345367 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.346432 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:53.346443 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:53.346463 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:53.347276 (+ 813us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:53.347338 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:53.347362 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:53.347520 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:53.347634 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 18:39:53.347755 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:39:53.349038 1612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:53.394253 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.393653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58216)
0810 18:39:53.393927 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.394051 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260810 18:39:53.395623 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.395129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58220)
0810 18:39:53.395330 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.395445 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 18:39:53.450805 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 1476
I20260810 18:39:53.456292 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.455805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58228)
0810 18:39:53.456050 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.456140 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260810 18:39:53.457494 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.457088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58232)
0810 18:39:53.457254 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.457346 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 18:39:53.478835 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 1620
I20260810 18:39:53.487035 1779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.479644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47482 (local address 127.13.139.3:45103)
0810 18:39:53.479841 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:53.479848 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:53.480096 (+ 248us) server_negotiation.cc:407] Connection header received
0810 18:39:53.480286 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:53.480290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:53.480387 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:53.480478 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:53.480971 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.481735 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.483629 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:53.484062 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:53.484156 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:53.485549 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:53.485560 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:53.485575 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:53.486204 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:53.486254 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:53.486274 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:53.486359 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:53.486564 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 18:39:53.486643 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 18:39:53.487766 1756 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:53.538048 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.537489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58234)
0810 18:39:53.537763 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.537899 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260810 18:39:53.539245 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.538828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58250)
0810 18:39:53.539038 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.539107 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260810 18:39:53.613008 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 1620
I20260810 18:39:53.636018 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 1228
I20260810 18:39:53.637207 1297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:53.749079 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:53.748500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42913 (local address 127.0.0.1:58256)
0810 18:39:53.748771 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:53.748893 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 18:39:53.749058 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 1228
2026-08-10T18:39:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3143 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:39:53 dist-test-slave-5k54 krb5kdc[1820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:39:53 dist-test-slave-5k54 krb5kdc[1820](info): set up 2 sockets
Aug 10 18:39:53 dist-test-slave-5k54 krb5kdc[1820](info): commencing operation
krb5kdc: starting...
W20260810 18:39:54.957405 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:39:55 dist-test-slave-5k54 krb5kdc[1820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:39:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:39:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:39:55.260740 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33683
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:33683
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:55.603657 1837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:55.603960 1837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:55.604177 1837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:55.611514 1837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:39:55.611651 1837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:55.611735 1837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:55.611851 1837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:39:55.611923 1837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:39:55.621896 1837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:33683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:55.623250 1837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:55.624619 1837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:55.636688 1845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:55.636785 1843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:55.636814 1842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:55.637665 1837 server_base.cc:1034] running on GCE node
I20260810 18:39:55.638451 1837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:55.639927 1837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:55.641152 1837 hybrid_clock.cc:648] HybridClock initialized: now 1786387195641077 us; error 54 us; skew 500 ppm
I20260810 18:39:55.641508 1837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:55 dist-test-slave-5k54 krb5kdc[1820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387195, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:55.648865 1837 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:39:55.650499 1837 webserver.cc:460] Webserver started at http://127.13.139.62:42789/ using document root <none> and password file <none>
I20260810 18:39:55.651173 1837 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:55.651292 1837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:55.651629 1837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:55.654767 1837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "f14bbde3b541426c9b2588763efc97fb"
format_stamp: "Formatted at 2026-08-10 18:39:55 on dist-test-slave-5k54"
server_key: "8de0166d3606adba0e007f16e2d79c1a"
server_key_iv: "812305951ae49a633fc0150a0c87a208"
server_key_version: "encryptionkey@0"
I20260810 18:39:55.655637 1837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "f14bbde3b541426c9b2588763efc97fb"
format_stamp: "Formatted at 2026-08-10 18:39:55 on dist-test-slave-5k54"
server_key: "8de0166d3606adba0e007f16e2d79c1a"
server_key_iv: "812305951ae49a633fc0150a0c87a208"
server_key_version: "encryptionkey@0"
I20260810 18:39:55.660916 1837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260810 18:39:55.664371 1855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:55.665742 1837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:39:55.665938 1837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "f14bbde3b541426c9b2588763efc97fb"
format_stamp: "Formatted at 2026-08-10 18:39:55 on dist-test-slave-5k54"
server_key: "8de0166d3606adba0e007f16e2d79c1a"
server_key_iv: "812305951ae49a633fc0150a0c87a208"
server_key_version: "encryptionkey@0"
I20260810 18:39:55.666150 1837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:55.704483 1837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:55.708616 1837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:55.708923 1837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:55.729118 1837 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:33683
I20260810 18:39:55.729156 1918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:33683 every 8 connection(s)
I20260810 18:39:55.730475 1837 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:39:55.730827 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 1837
I20260810 18:39:55.731017 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:39:55.731667 13868 external_mini_cluster.cc:1428] Setting key a7ca3c471c2c8790242a553cc8fdb630
I20260810 18:39:55.734956 1919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 18:39:55 dist-test-slave-5k54 krb5kdc[1820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:55.745492 1919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb: Bootstrap starting.
I20260810 18:39:55.748646 1919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:55.749751 1919 log.cc:824] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:55.753140 1919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb: No bootstrap required, opened a new log
I20260810 18:39:55.754132 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:55.733586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36754 (local address 127.13.139.62:33683)
0810 18:39:55.734341 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:55.734353 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:55.734390 (+ 37us) server_negotiation.cc:407] Connection header received
0810 18:39:55.736149 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:55.736172 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:55.736526 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:55.736885 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:55.738340 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:55.739733 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:55.741100 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:55.741749 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:55.741952 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:55.746470 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:55.746477 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:55.746490 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:55.746528 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:55.749721 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:55.750568 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:55.750574 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:55.750579 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:55.750744 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:55.751226 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:55.751231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:55.751234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:55.751826 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:55.752134 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:55.752711 (+ 577us) server_negotiation.cc:299] Negotiation successful
0810 18:39:55.753052 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":337,"threads_started":1}
I20260810 18:39:55.761368 1919 raft_consensus.cc:348] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14bbde3b541426c9b2588763efc97fb" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33683 } }
I20260810 18:39:55.761745 1919 raft_consensus.cc:374] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:55.761861 1919 raft_consensus.cc:729] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14bbde3b541426c9b2588763efc97fb, State: Initialized, Role: FOLLOWER
I20260810 18:39:55.762413 1919 consensus_queue.cc:260] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14bbde3b541426c9b2588763efc97fb" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33683 } }
I20260810 18:39:55.762661 1919 raft_consensus.cc:388] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:39:55.762814 1919 raft_consensus.cc:482] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:39:55.762995 1919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:55.765268 1919 raft_consensus.cc:504] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14bbde3b541426c9b2588763efc97fb" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33683 } }
I20260810 18:39:55.765800 1919 leader_election.cc:302] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f14bbde3b541426c9b2588763efc97fb; no voters:
I20260810 18:39:55.766548 1919 leader_election.cc:288] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:39:55.766674 1924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:55.767472 1924 raft_consensus.cc:686] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [term 1 LEADER]: Becoming Leader. State: Replica: f14bbde3b541426c9b2588763efc97fb, State: Running, Role: LEADER
I20260810 18:39:55.767972 1924 consensus_queue.cc:237] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14bbde3b541426c9b2588763efc97fb" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33683 } }
I20260810 18:39:55.768721 1919 sys_catalog.cc:564] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:39:55.770910 1926 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f14bbde3b541426c9b2588763efc97fb. Latest consensus state: current_term: 1 leader_uuid: "f14bbde3b541426c9b2588763efc97fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14bbde3b541426c9b2588763efc97fb" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33683 } } }
I20260810 18:39:55.771390 1926 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:55.771950 1925 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f14bbde3b541426c9b2588763efc97fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14bbde3b541426c9b2588763efc97fb" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33683 } } }
I20260810 18:39:55.772292 1925 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:55.773870 1930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:39:55.779863 1930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:39:55.788373 1930 catalog_manager.cc:1347] Generated new cluster ID: ad192c4f4a9f462493bede3209cdcdb7
I20260810 18:39:55.788476 1930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:39:55.805222 1930 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:39:55.806802 1930 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:39:55.811800 1930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb: Generated new TSK 0
I20260810 18:39:55.812592 1930 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:39:55.900110 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33683
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:56.240346 1950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:56.240648 1950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:56.240845 1950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:56.248208 1950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:56.248312 1950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:56.248518 1950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:39:56.258801 1950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:56.260179 1950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:56.261515 1950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:56.275009 1959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:56.275051 1955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:56.275075 1956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:56.276610 1950 server_base.cc:1034] running on GCE node
I20260810 18:39:56.277133 1950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:56.278015 1950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:56.279230 1950 hybrid_clock.cc:648] HybridClock initialized: now 1786387196279193 us; error 53 us; skew 500 ppm
I20260810 18:39:56.279606 1950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:56 dist-test-slave-5k54 krb5kdc[1820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387196, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:56.282809 1950 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:39:56.284273 1950 webserver.cc:460] Webserver started at http://127.13.139.1:39601/ using document root <none> and password file <none>
I20260810 18:39:56.284981 1950 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:56.285126 1950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:56.285445 1950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:56.288367 1950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "684115c2daee4578998522fb12db355f"
format_stamp: "Formatted at 2026-08-10 18:39:56 on dist-test-slave-5k54"
server_key: "adf54dd3d40b387e251230d78be82b36"
server_key_iv: "195da0b80742adc36071b8cef104add3"
server_key_version: "encryptionkey@0"
I20260810 18:39:56.289136 1950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "684115c2daee4578998522fb12db355f"
format_stamp: "Formatted at 2026-08-10 18:39:56 on dist-test-slave-5k54"
server_key: "adf54dd3d40b387e251230d78be82b36"
server_key_iv: "195da0b80742adc36071b8cef104add3"
server_key_version: "encryptionkey@0"
I20260810 18:39:56.294219 1950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:39:56.297636 1966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:56.299003 1950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260810 18:39:56.299183 1950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "684115c2daee4578998522fb12db355f"
format_stamp: "Formatted at 2026-08-10 18:39:56 on dist-test-slave-5k54"
server_key: "adf54dd3d40b387e251230d78be82b36"
server_key_iv: "195da0b80742adc36071b8cef104add3"
server_key_version: "encryptionkey@0"
I20260810 18:39:56.299383 1950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:56.325222 1950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:56.329727 1950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:56.330036 1950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:56.331048 1950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:56.332466 1950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:56.332573 1950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:56.332722 1950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:56.332798 1950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:56.366429 1950 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:36787
I20260810 18:39:56.366523 2088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:36787 every 8 connection(s)
I20260810 18:39:56.367731 1950 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:39:56.369652 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 1950
I20260810 18:39:56.369859 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:39:56.370553 13868 external_mini_cluster.cc:1428] Setting key 87df67f9fe2112540f381afda1c2011c
Aug 10 18:39:56 dist-test-slave-5k54 krb5kdc[1820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387196, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:56.389094 2092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:56.370500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:36869 (local address 127.13.139.62:33683)
0810 18:39:56.374520 (+ 4020us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:56.374525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:56.374540 (+ 15us) server_negotiation.cc:407] Connection header received
0810 18:39:56.374586 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:56.374590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:56.374650 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:56.374772 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:56.376391 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.377084 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.378670 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.379080 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.379217 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:56.382748 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:56.382753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:56.382756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:56.382808 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:56.385538 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:56.386525 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:56.386532 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:56.386536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:56.386694 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:56.387251 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:56.387254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:56.387256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:56.387601 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:56.387762 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:56.388491 (+ 729us) server_negotiation.cc:299] Negotiation successful
0810 18:39:56.388731 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3920,"thread_start_us":3813,"threads_started":1}
I20260810 18:39:56.390126 2093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:56.371177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33683 (local address 127.13.139.1:36869)
0810 18:39:56.372056 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:56.372109 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:56.373952 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:56.375034 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:56.375042 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:56.375669 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:56.376217 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:56.376234 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.377254 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.377258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:56.378515 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:56.378531 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.379302 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.379309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:56.379612 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:56.380329 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:56.380351 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:56.382529 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:56.385693 (+ 3164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:56.385703 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:56.385719 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:56.386336 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:56.386827 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:56.386833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:56.386839 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:56.387123 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:56.387736 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:56.387745 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:56.388089 (+ 344us) client_negotiation.cc:769] Sending connection context
0810 18:39:56.388366 (+ 277us) client_negotiation.cc:240] Negotiation successful
0810 18:39:56.388904 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":379,"threads_started":1}
I20260810 18:39:56.391908 2090 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33683
I20260810 18:39:56.392271 2090 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:56.393031 2090 heartbeater.cc:511] Master 127.13.139.62:33683 requested a full tablet report, sending...
I20260810 18:39:56.395328 1883 ts_manager.cc:194] Registered new tserver with Master: 684115c2daee4578998522fb12db355f (127.13.139.1:36787)
I20260810 18:39:56.396865 1883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:36869
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:39:56.442682 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33683
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:56.818013 2096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:56.818382 2096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:56.818554 2096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:56.826134 2096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:56.826334 2096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:56.826521 2096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:39:56.837041 2096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:56.838510 2096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:56.839964 2096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:56.852774 2101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:56.853159 2102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:56.854022 2105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:56.854491 2096 server_base.cc:1034] running on GCE node
I20260810 18:39:56.855269 2096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:56.856266 2096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:56.857580 2096 hybrid_clock.cc:648] HybridClock initialized: now 1786387196857519 us; error 57 us; skew 500 ppm
I20260810 18:39:56.857951 2096 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:56 dist-test-slave-5k54 krb5kdc[1820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387196, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:56.861527 2096 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:39:56.863122 2096 webserver.cc:460] Webserver started at http://127.13.139.2:40733/ using document root <none> and password file <none>
I20260810 18:39:56.863936 2096 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:56.864090 2096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:56.864439 2096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:56.867354 2096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "31d91a551e904e9da03dec95cd79a143"
format_stamp: "Formatted at 2026-08-10 18:39:56 on dist-test-slave-5k54"
server_key: "fb0c5d5102662f5cb61dfad54f865447"
server_key_iv: "bb08bbbabe92c28218fb3afba5f37828"
server_key_version: "encryptionkey@0"
I20260810 18:39:56.868232 2096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "31d91a551e904e9da03dec95cd79a143"
format_stamp: "Formatted at 2026-08-10 18:39:56 on dist-test-slave-5k54"
server_key: "fb0c5d5102662f5cb61dfad54f865447"
server_key_iv: "bb08bbbabe92c28218fb3afba5f37828"
server_key_version: "encryptionkey@0"
I20260810 18:39:56.875730 2096 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260810 18:39:56.880369 2114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:56.881820 2096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:39:56.882035 2096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "31d91a551e904e9da03dec95cd79a143"
format_stamp: "Formatted at 2026-08-10 18:39:56 on dist-test-slave-5k54"
server_key: "fb0c5d5102662f5cb61dfad54f865447"
server_key_iv: "bb08bbbabe92c28218fb3afba5f37828"
server_key_version: "encryptionkey@0"
I20260810 18:39:56.882249 2096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:56.925544 2096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:56.930256 2096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:56.930593 2096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:56.931679 2096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:56.933094 2096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:56.933213 2096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:56.933378 2096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:56.933458 2096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:56.969123 2096 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:37541
I20260810 18:39:56.969092 2243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:37541 every 8 connection(s)
I20260810 18:39:56.970741 2096 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:39:56.979997 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 2096
I20260810 18:39:56.980198 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:39:56.980669 13868 external_mini_cluster.cc:1428] Setting key d126777b284c05769c37d0ff65ac7e6d
Aug 10 18:39:56 dist-test-slave-5k54 krb5kdc[1820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387196, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:56.993362 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:56.973441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:46571 (local address 127.13.139.62:33683)
0810 18:39:56.973943 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:56.973948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:56.974760 (+ 812us) server_negotiation.cc:407] Connection header received
0810 18:39:56.976832 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:56.976838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:56.976939 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:56.977068 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:56.978595 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.979306 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.981124 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.981784 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.981917 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:56.986121 (+ 4204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:56.986130 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:56.986140 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:56.986175 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:56.989495 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:56.990495 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:56.990502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:56.990507 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:56.990660 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:56.991177 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:56.991183 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:56.991188 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:56.991564 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:56.991707 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:56.992672 (+ 965us) server_negotiation.cc:299] Negotiation successful
0810 18:39:56.992909 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":260,"threads_started":1}
I20260810 18:39:56.994962 2248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:56.973839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33683 (local address 127.13.139.2:46571)
0810 18:39:56.974574 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:56.974613 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:56.976557 (+ 1944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:56.977315 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:56.977325 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:56.977855 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:56.978412 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:56.978430 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.979489 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.979495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:56.980970 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:56.980988 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:56.982023 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:56.982028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:56.982227 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:56.983025 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:56.983057 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:56.985812 (+ 2755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:56.989656 (+ 3844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:56.989668 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:56.989686 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:56.990361 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:56.990776 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:56.990784 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:56.990790 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:56.991053 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:56.991697 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:56.991708 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:56.992205 (+ 497us) client_negotiation.cc:769] Sending connection context
0810 18:39:56.992557 (+ 352us) client_negotiation.cc:240] Negotiation successful
0810 18:39:56.993144 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":306,"threads_started":1}
I20260810 18:39:56.997938 2244 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33683
I20260810 18:39:56.998296 2244 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:56.999003 2244 heartbeater.cc:511] Master 127.13.139.62:33683 requested a full tablet report, sending...
I20260810 18:39:57.000700 1883 ts_manager.cc:194] Registered new tserver with Master: 31d91a551e904e9da03dec95cd79a143 (127.13.139.2:37541)
I20260810 18:39:57.001986 1883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:46571
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:39:57.054207 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33683
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:39:57.396230 2251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:57.396503 2251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:57.396595 2251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 18:39:57.400027 2090 heartbeater.cc:503] Master 127.13.139.62:33683 was elected leader, sending a full tablet report...
W20260810 18:39:57.404198 2251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:57.404323 2251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:57.404508 2251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:39:57.414086 2251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:57.415319 2251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:57.416622 2251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:57.429318 2257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:57.429683 2259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:57.429980 2256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:57.431906 2251 server_base.cc:1034] running on GCE node
I20260810 18:39:57.432559 2251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:57.433852 2251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:57.435091 2251 hybrid_clock.cc:648] HybridClock initialized: now 1786387197435044 us; error 37 us; skew 500 ppm
I20260810 18:39:57.435468 2251 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:39:57 dist-test-slave-5k54 krb5kdc[1820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387197, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:39:57.438999 2251 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:39:57.440642 2251 webserver.cc:460] Webserver started at http://127.13.139.3:40169/ using document root <none> and password file <none>
I20260810 18:39:57.441334 2251 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:57.441473 2251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:57.441828 2251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:57.445075 2251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "097327fee5f94602830e219e599c376a"
format_stamp: "Formatted at 2026-08-10 18:39:57 on dist-test-slave-5k54"
server_key: "410f3fcc6a7ebb8c1d55a864b2323d4a"
server_key_iv: "ba45c93d18211ccb57d7d1677e62ee79"
server_key_version: "encryptionkey@0"
I20260810 18:39:57.446218 2251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "097327fee5f94602830e219e599c376a"
format_stamp: "Formatted at 2026-08-10 18:39:57 on dist-test-slave-5k54"
server_key: "410f3fcc6a7ebb8c1d55a864b2323d4a"
server_key_iv: "ba45c93d18211ccb57d7d1677e62ee79"
server_key_version: "encryptionkey@0"
I20260810 18:39:57.451576 2251 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260810 18:39:57.455111 2268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:57.456581 2251 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:39:57.456717 2251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "097327fee5f94602830e219e599c376a"
format_stamp: "Formatted at 2026-08-10 18:39:57 on dist-test-slave-5k54"
server_key: "410f3fcc6a7ebb8c1d55a864b2323d4a"
server_key_iv: "ba45c93d18211ccb57d7d1677e62ee79"
server_key_version: "encryptionkey@0"
I20260810 18:39:57.456894 2251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:57.471661 2251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:57.475916 2251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:57.476150 2251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:57.477000 2251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:57.478276 2251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:57.478349 2251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:57.478431 2251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:57.478479 2251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:57.512605 2251 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:44963
I20260810 18:39:57.512650 2391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:44963 every 8 connection(s)
I20260810 18:39:57.513926 2251 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:39:57.515839 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 2251
I20260810 18:39:57.516049 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:39:57.516592 13868 external_mini_cluster.cc:1428] Setting key 6b2515e6405491a6377f824e98181760
Aug 10 18:39:57 dist-test-slave-5k54 krb5kdc[1820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387197, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:39:57.534789 2394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.516792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:58603 (local address 127.13.139.62:33683)
0810 18:39:57.517350 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.517354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.518778 (+ 1424us) server_negotiation.cc:407] Connection header received
0810 18:39:57.520757 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.520761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.520843 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.520950 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:57.522423 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.523175 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.524754 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.525164 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.525256 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.528924 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:57.528928 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:57.528931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:57.528962 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:57.532149 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.532828 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.532832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.532834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.532957 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.533337 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.533340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.533342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.533598 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:57.533712 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.534357 (+ 645us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.534529 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":259,"threads_started":1}
I20260810 18:39:57.535753 2396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.517485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33683 (local address 127.13.139.3:58603)
0810 18:39:57.518379 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:57.518461 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:57.520518 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:57.521160 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:57.521168 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:57.521726 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:57.522271 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.522288 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.523304 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.523308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.524630 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.524642 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.525347 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.525352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.525553 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.526290 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:39:57.526325 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:57.528729 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:57.532293 (+ 3564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:57.532300 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:57.532313 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:57.532714 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:57.533052 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:39:57.533055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:39:57.533057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:39:57.533228 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:39:57.533704 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:57.533709 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:57.534031 (+ 322us) client_negotiation.cc:769] Sending connection context
0810 18:39:57.534241 (+ 210us) client_negotiation.cc:240] Negotiation successful
0810 18:39:57.534595 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":363,"threads_started":1}
I20260810 18:39:57.537017 2392 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33683
I20260810 18:39:57.537329 2392 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:57.538031 2392 heartbeater.cc:511] Master 127.13.139.62:33683 requested a full tablet report, sending...
I20260810 18:39:57.539347 1883 ts_manager.cc:194] Registered new tserver with Master: 097327fee5f94602830e219e599c376a (127.13.139.3:44963)
I20260810 18:39:57.540195 1883 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:58603
I20260810 18:39:57.544494 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:39:57.561793 2394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.548589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36760 (local address 127.13.139.62:33683)
0810 18:39:57.548745 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.548749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.549193 (+ 444us) server_negotiation.cc:407] Connection header received
0810 18:39:57.549319 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.549323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.549390 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.549467 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:57.550831 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.551626 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.552956 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.553325 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.553410 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.556196 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:57.556202 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:57.556207 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:57.556240 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:57.558571 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.559386 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.559389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.559391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.559592 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.560229 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.560237 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.560243 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.560677 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:57.560915 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.561342 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.561482 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:39:57.565685 1883 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:39:57.572773 1883 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:39:57.595224 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.585049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34394 (local address 127.13.139.3:44963)
0810 18:39:57.585882 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.585891 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.585937 (+ 46us) server_negotiation.cc:407] Connection header received
0810 18:39:57.586093 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.586102 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.586362 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.588204 (+ 1842us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:57.588501 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.589587 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.592318 (+ 2731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.593850 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.593997 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.594236 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.594692 (+ 456us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.594849 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":410,"threads_started":1}
I20260810 18:39:57.595248 2407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.584706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:44963 (local address 127.0.0.1:34394)
0810 18:39:57.585514 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:57.585564 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:57.585758 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:57.586619 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:57.586645 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:57.586676 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:57.587281 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.587295 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.589731 (+ 2436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.589739 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.592135 (+ 2396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.592150 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.594105 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.594117 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.594348 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.594423 (+ 75us) client_negotiation.cc:769] Sending connection context
0810 18:39:57.594622 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 18:39:57.594805 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":3,"thread_start_us":405,"threads_started":1}
I20260810 18:39:57.598099 2411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.586580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:37541 (local address 127.0.0.1:59742)
0810 18:39:57.587894 (+ 1314us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:57.587910 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:57.588012 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:57.590743 (+ 2731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:57.590748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:57.590771 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:57.591337 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.591354 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.593211 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.593219 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.595741 (+ 2522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.595756 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.597251 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.597259 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.597432 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.597463 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 18:39:57.597537 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 18:39:57.597667 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1192,"mutex_wait_us":282,"thread_start_us":1045,"threads_started":1}
I20260810 18:39:57.598433 2409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.585950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36787 (local address 127.0.0.1:49146)
0810 18:39:57.586512 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:57.586532 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:57.586628 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:57.591073 (+ 4445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:57.591080 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:57.591120 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:57.591622 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.591635 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.593327 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.593334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.595609 (+ 2275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.595623 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.597549 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.597556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.597716 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.597754 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 18:39:57.597886 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 18:39:57.598022 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":4,"thread_start_us":283,"threads_started":1}
I20260810 18:39:57.598807 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.586245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49146 (local address 127.13.139.1:36787)
0810 18:39:57.590495 (+ 4250us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.590501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.590522 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:39:57.590621 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.590628 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.590849 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.591734 (+ 885us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:57.591960 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.593093 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.595822 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.597341 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.597495 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.597704 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.597929 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.598080 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4099,"thread_start_us":3965,"threads_started":1}
I20260810 18:39:57.599176 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.587147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59742 (local address 127.13.139.2:37541)
0810 18:39:57.590156 (+ 3009us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.590165 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.590191 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:39:57.590282 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.590290 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.590530 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.591121 (+ 591us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:57.591535 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.593059 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.595931 (+ 2872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.597014 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.598440 (+ 1426us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.598618 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.598678 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.598841 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2852,"thread_start_us":2692,"threads_started":1}
I20260810 18:39:57.600172 2317 tablet_service.cc:1467] Processing CreateTablet for tablet 94280f1e04c54a619a18ef53dc3a6ad8 (DEFAULT_TABLE table=test-table [id=28f00fc370e2424fba65a3261ef490a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:57.601792 2317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94280f1e04c54a619a18ef53dc3a6ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:57.602195 2016 tablet_service.cc:1467] Processing CreateTablet for tablet 94280f1e04c54a619a18ef53dc3a6ad8 (DEFAULT_TABLE table=test-table [id=28f00fc370e2424fba65a3261ef490a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:57.602617 2165 tablet_service.cc:1467] Processing CreateTablet for tablet 94280f1e04c54a619a18ef53dc3a6ad8 (DEFAULT_TABLE table=test-table [id=28f00fc370e2424fba65a3261ef490a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:39:57.603281 2016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94280f1e04c54a619a18ef53dc3a6ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:57.603878 2165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94280f1e04c54a619a18ef53dc3a6ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:57.614836 2415 tablet_bootstrap.cc:492] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Bootstrap starting.
I20260810 18:39:57.618160 2417 tablet_bootstrap.cc:492] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Bootstrap starting.
I20260810 18:39:57.618212 2415 tablet_bootstrap.cc:654] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:57.620435 2415 log.cc:824] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:57.620788 2416 tablet_bootstrap.cc:492] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Bootstrap starting.
I20260810 18:39:57.621933 2417 tablet_bootstrap.cc:654] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:57.623486 2417 log.cc:824] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:57.623891 2416 tablet_bootstrap.cc:654] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:57.625180 2416 log.cc:824] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:57.626775 2415 tablet_bootstrap.cc:492] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: No bootstrap required, opened a new log
I20260810 18:39:57.626785 2417 tablet_bootstrap.cc:492] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: No bootstrap required, opened a new log
I20260810 18:39:57.627045 2417 ts_tablet_manager.cc:1397] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260810 18:39:57.627058 2415 ts_tablet_manager.cc:1397] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260810 18:39:57.628228 2416 tablet_bootstrap.cc:492] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: No bootstrap required, opened a new log
I20260810 18:39:57.628472 2416 ts_tablet_manager.cc:1397] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 18:39:57.634419 2417 raft_consensus.cc:348] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.634801 2417 raft_consensus.cc:374] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:57.634897 2417 raft_consensus.cc:729] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d91a551e904e9da03dec95cd79a143, State: Initialized, Role: FOLLOWER
I20260810 18:39:57.635609 2417 consensus_queue.cc:260] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.636673 2244 heartbeater.cc:503] Master 127.13.139.62:33683 was elected leader, sending a full tablet report...
I20260810 18:39:57.637799 2415 raft_consensus.cc:348] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.638216 2415 raft_consensus.cc:374] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:57.638307 2415 raft_consensus.cc:729] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 684115c2daee4578998522fb12db355f, State: Initialized, Role: FOLLOWER
I20260810 18:39:57.638734 2417 ts_tablet_manager.cc:1428] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20260810 18:39:57.638896 2415 consensus_queue.cc:260] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.639292 2416 raft_consensus.cc:348] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.640236 2416 raft_consensus.cc:374] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:57.640340 2416 raft_consensus.cc:729] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 097327fee5f94602830e219e599c376a, State: Initialized, Role: FOLLOWER
I20260810 18:39:57.641196 2415 ts_tablet_manager.cc:1428] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260810 18:39:57.641032 2416 consensus_queue.cc:260] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.642138 2392 heartbeater.cc:503] Master 127.13.139.62:33683 was elected leader, sending a full tablet report...
I20260810 18:39:57.642743 2416 ts_tablet_manager.cc:1428] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260810 18:39:57.712576 2423 raft_consensus.cc:482] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:39:57.712950 2423 raft_consensus.cc:504] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.715008 2423 leader_election.cc:288] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 097327fee5f94602830e219e599c376a (127.13.139.3:44963), 31d91a551e904e9da03dec95cd79a143 (127.13.139.2:37541)
I20260810 18:39:57.722133 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.715308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:41115 (local address 127.13.139.3:44963)
0810 18:39:57.715576 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.715584 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.716237 (+ 653us) server_negotiation.cc:407] Connection header received
0810 18:39:57.716502 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.716508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.716589 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.716656 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:57.717563 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.718398 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.720307 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.721118 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.721238 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.721341 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.721718 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.721857 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:39:57.722251 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.715376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:44963 (local address 127.13.139.1:41115)
0810 18:39:57.716070 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:57.716120 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:57.716280 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:57.716834 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:57.716837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:57.716961 (+ 124us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:57.717385 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.717397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.718554 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.718559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.720121 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.720133 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.721335 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.721341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.721533 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.721580 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 18:39:57.721652 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 18:39:57.721734 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":3,"spinlock_wait_cycles":21888,"thread_start_us":378,"threads_started":1}
I20260810 18:39:57.722244 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.716387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:42479 (local address 127.13.139.2:37541)
0810 18:39:57.716592 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.716599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.716920 (+ 321us) server_negotiation.cc:407] Connection header received
0810 18:39:57.717006 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.717013 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.717097 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.717204 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:39:57.717826 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.718560 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.720408 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.721195 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.721351 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.721426 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.721826 (+ 400us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.721978 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:39:57.722697 2426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.716149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:37541 (local address 127.13.139.1:42479)
0810 18:39:57.716790 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:57.716803 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:57.716914 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:57.717223 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:57.717226 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:57.717246 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:39:57.717640 (+ 394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.717654 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.718695 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.718699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.720244 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:57.720260 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.721441 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.721445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:57.721622 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.721681 (+ 59us) client_negotiation.cc:769] Sending connection context
0810 18:39:57.721778 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 18:39:57.721893 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":42,"thread_start_us":329,"threads_started":1}
W20260810 18:39:57.722903 2246 tablet.cc:2369] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:39:57.723356 2340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94280f1e04c54a619a18ef53dc3a6ad8" candidate_uuid: "684115c2daee4578998522fb12db355f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097327fee5f94602830e219e599c376a" is_pre_election: true
I20260810 18:39:57.723819 2197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94280f1e04c54a619a18ef53dc3a6ad8" candidate_uuid: "684115c2daee4578998522fb12db355f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d91a551e904e9da03dec95cd79a143" is_pre_election: true
I20260810 18:39:57.723968 2340 raft_consensus.cc:2454] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 684115c2daee4578998522fb12db355f in term 0.
I20260810 18:39:57.724278 2197 raft_consensus.cc:2454] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 684115c2daee4578998522fb12db355f in term 0.
I20260810 18:39:57.724679 1969 leader_election.cc:302] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 097327fee5f94602830e219e599c376a, 684115c2daee4578998522fb12db355f; no voters:
I20260810 18:39:57.725044 2423 raft_consensus.cc:2781] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:39:57.725176 2423 raft_consensus.cc:482] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:39:57.725332 2423 raft_consensus.cc:3037] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:57.727527 2423 raft_consensus.cc:504] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.728091 2423 leader_election.cc:288] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [CANDIDATE]: Term 1 election: Requested vote from peers 097327fee5f94602830e219e599c376a (127.13.139.3:44963), 31d91a551e904e9da03dec95cd79a143 (127.13.139.2:37541)
I20260810 18:39:57.728708 2197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94280f1e04c54a619a18ef53dc3a6ad8" candidate_uuid: "684115c2daee4578998522fb12db355f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d91a551e904e9da03dec95cd79a143"
I20260810 18:39:57.728679 2340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94280f1e04c54a619a18ef53dc3a6ad8" candidate_uuid: "684115c2daee4578998522fb12db355f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "097327fee5f94602830e219e599c376a"
I20260810 18:39:57.728904 2340 raft_consensus.cc:3037] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:57.728938 2197 raft_consensus.cc:3037] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:57.732224 2197 raft_consensus.cc:2454] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 684115c2daee4578998522fb12db355f in term 1.
I20260810 18:39:57.732224 2340 raft_consensus.cc:2454] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 684115c2daee4578998522fb12db355f in term 1.
I20260810 18:39:57.732649 1969 leader_election.cc:302] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d91a551e904e9da03dec95cd79a143, 684115c2daee4578998522fb12db355f; no voters:
I20260810 18:39:57.732928 2423 raft_consensus.cc:2781] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:57.733381 2423 raft_consensus.cc:686] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 1 LEADER]: Becoming Leader. State: Replica: 684115c2daee4578998522fb12db355f, State: Running, Role: LEADER
I20260810 18:39:57.733920 2423 consensus_queue.cc:237] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } }
I20260810 18:39:57.738945 1883 catalog_manager.cc:5495] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f reported cstate change: term changed from 0 to 1, leader changed from <none> to 684115c2daee4578998522fb12db355f (127.13.139.1). New cstate: current_term: 1 leader_uuid: "684115c2daee4578998522fb12db355f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "684115c2daee4578998522fb12db355f" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 } health_report { overall_health: UNKNOWN } } }
I20260810 18:39:57.756342 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.750922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49148 (local address 127.13.139.1:36787)
0810 18:39:57.751111 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.751116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.751133 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:39:57.751202 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.751206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.751284 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.751409 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:39:57.751820 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.752569 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.754063 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.754469 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.754565 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.755089 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:39:57.755665 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:39:57.755814 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.755983 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.756052 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 18:39:57.764708 2197 raft_consensus.cc:1261] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 1 FOLLOWER]: Refusing update from remote peer 684115c2daee4578998522fb12db355f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:39:57.764736 2340 raft_consensus.cc:1261] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 1 FOLLOWER]: Refusing update from remote peer 684115c2daee4578998522fb12db355f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 18:39:57.765614 2393 tablet.cc:2369] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:39:57.765735 2427 consensus_queue.cc:1035] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [LEADER]: Connected to new peer: Peer: permanent_uuid: "097327fee5f94602830e219e599c376a" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:39:57.766150 2423 consensus_queue.cc:1035] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d91a551e904e9da03dec95cd79a143" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:39:57.776500 2431 mvcc.cc:205] Tried to move back new op lower bound from 7317041962034552832 to 7317041961922506752. Current Snapshot: MvccSnapshot[applied={T|T < 7317041962034552832}]
I20260810 18:39:57.778910 2433 mvcc.cc:205] Tried to move back new op lower bound from 7317041962034552832 to 7317041961922506752. Current Snapshot: MvccSnapshot[applied={T|T < 7317041962034552832}]
I20260810 18:39:57.793044 1883 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:57.793322 1883 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:39:57.797029 1883 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f14bbde3b541426c9b2588763efc97fb: Sending DeleteTablet for 3 replicas of tablet 94280f1e04c54a619a18ef53dc3a6ad8
I20260810 18:39:57.798202 2317 tablet_service.cc:1514] Processing DeleteTablet for tablet 94280f1e04c54a619a18ef53dc3a6ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:57 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:34394
I20260810 18:39:57.798306 2016 tablet_service.cc:1514] Processing DeleteTablet for tablet 94280f1e04c54a619a18ef53dc3a6ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:57 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:49146
I20260810 18:39:57.798461 2165 tablet_service.cc:1514] Processing DeleteTablet for tablet 94280f1e04c54a619a18ef53dc3a6ad8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:39:57 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:59742
I20260810 18:39:57.803401 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 1950
I20260810 18:39:57.814368 2443 tablet_replica.cc:330] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: stopping tablet replica
I20260810 18:39:57.814848 2443 raft_consensus.cc:2229] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:39:57.815653 2443 raft_consensus.cc:2258] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:57.818200 2443 ts_tablet_manager.cc:1905] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:57.821473 2442 tablet_replica.cc:330] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: stopping tablet replica
I20260810 18:39:57.822190 2444 tablet_replica.cc:330] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: stopping tablet replica
I20260810 18:39:57.822718 2444 raft_consensus.cc:2229] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:57.823276 2442 raft_consensus.cc:2229] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:39:57.823951 2444 raft_consensus.cc:2258] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:57.824849 2442 raft_consensus.cc:2258] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:39:57.826171 2443 ts_tablet_manager.cc:1918] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:57.826349 2443 log.cc:1196] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/94280f1e04c54a619a18ef53dc3a6ad8
I20260810 18:39:57.826890 2443 ts_tablet_manager.cc:1939] T 94280f1e04c54a619a18ef53dc3a6ad8 P 684115c2daee4578998522fb12db355f: Deleting consensus metadata
I20260810 18:39:57.828327 2444 ts_tablet_manager.cc:1905] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:39:57.828879 1858 catalog_manager.cc:4841] TS 684115c2daee4578998522fb12db355f (127.13.139.1:36787): tablet 94280f1e04c54a619a18ef53dc3a6ad8 (table test-table [id=28f00fc370e2424fba65a3261ef490a0]) successfully deleted
I20260810 18:39:57.829734 2442 ts_tablet_manager.cc:1905] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 18:39:57 dist-test-slave-5k54 krb5kdc[1820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:39:57.836864 2444 ts_tablet_manager.cc:1918] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:57.836864 2442 ts_tablet_manager.cc:1918] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:39:57.837044 2444 log.cc:1196] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/94280f1e04c54a619a18ef53dc3a6ad8
I20260810 18:39:57.837049 2442 log.cc:1196] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/94280f1e04c54a619a18ef53dc3a6ad8
I20260810 18:39:57.837623 2442 ts_tablet_manager.cc:1939] T 94280f1e04c54a619a18ef53dc3a6ad8 P 097327fee5f94602830e219e599c376a: Deleting consensus metadata
I20260810 18:39:57.837626 2444 ts_tablet_manager.cc:1939] T 94280f1e04c54a619a18ef53dc3a6ad8 P 31d91a551e904e9da03dec95cd79a143: Deleting consensus metadata
I20260810 18:39:57.839505 1858 catalog_manager.cc:4841] TS 097327fee5f94602830e219e599c376a (127.13.139.3:44963): tablet 94280f1e04c54a619a18ef53dc3a6ad8 (table test-table [id=28f00fc370e2424fba65a3261ef490a0]) successfully deleted
I20260810 18:39:57.839838 1858 catalog_manager.cc:4841] TS 31d91a551e904e9da03dec95cd79a143 (127.13.139.2:37541): tablet 94280f1e04c54a619a18ef53dc3a6ad8 (table test-table [id=28f00fc370e2424fba65a3261ef490a0]) successfully deleted
I20260810 18:39:57.841599 2410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.806714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49162 (local address 127.13.139.1:36787)
0810 18:39:57.806963 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.806972 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.815938 (+ 8966us) server_negotiation.cc:407] Connection header received
0810 18:39:57.822186 (+ 6248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.822192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.822315 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.822422 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:57.824385 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.825715 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.827657 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.828327 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.828496 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.834341 (+ 5845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:57.834358 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:57.834376 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:57.834430 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:57.838170 (+ 3740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.839120 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.839130 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.839133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.839317 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.839840 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.839845 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.839849 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.840370 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:57.840627 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.841017 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.841263 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 18:39:57.842330 2083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:57.941865 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 1950
I20260810 18:39:57.963896 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 2096
Aug 10 18:39:57 dist-test-slave-5k54 krb5kdc[1820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:39:57.981102 2414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:57.964827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59756 (local address 127.13.139.2:37541)
0810 18:39:57.965041 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:57.965047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:57.965067 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:39:57.965285 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:57.965290 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:57.965374 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:57.965502 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:57.966874 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.967728 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.969334 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:57.970003 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:57.970156 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:57.974934 (+ 4778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:57.974944 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:57.974957 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:57.974999 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:57.978081 (+ 3082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.978826 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.978834 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.978836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.978958 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:57.979376 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:57.979382 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:57.979385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:57.979847 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:57.980180 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:57.980501 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 18:39:57.980718 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:39:57.981803 2239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:58.072803 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 2096
I20260810 18:39:58.093736 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 2251
Aug 10 18:39:58 dist-test-slave-5k54 krb5kdc[1820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:39:58.110199 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:58.094714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34396 (local address 127.13.139.3:44963)
0810 18:39:58.094939 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:58.094947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:58.095024 (+ 77us) server_negotiation.cc:407] Connection header received
0810 18:39:58.095281 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:58.095291 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:58.095375 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:58.095528 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:58.096954 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:58.097709 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:58.099189 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:58.099775 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:58.099925 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:58.104627 (+ 4702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:58.104644 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:58.104661 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:39:58.104697 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:58.107576 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:58.108302 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:58.108310 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:58.108312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:58.108491 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:39:58.108836 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:39:58.108840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:39:58.108842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:39:58.109201 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:58.109440 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:58.109751 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 18:39:58.109937 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260810 18:39:58.110945 2386 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:58.201354 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 2251
I20260810 18:39:58.221010 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 1837
I20260810 18:39:58.222218 1914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:39:58.332986 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 1837
2026-08-10T18:39:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4585 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T18:39:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:39:58Z Disabled control of system clock
I20260810 18:39:58.424315 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46391
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:41145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:46391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 18:39:58.773780 2454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:58.774143 2454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:58.774323 2454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:58.782807 2454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:39:58.782940 2454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:58.783046 2454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:58.783155 2454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:39:58.783245 2454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:39:58.794056 2454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:46391
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:58.795538 2454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:58.797569 2454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:58.811064 2461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:58.811162 2463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:58.811096 2460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:58.811933 2454 server_base.cc:1034] running on GCE node
I20260810 18:39:58.812772 2454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:58.814347 2454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:58.815600 2454 hybrid_clock.cc:648] HybridClock initialized: now 1786387198815543 us; error 60 us; skew 500 ppm
I20260810 18:39:58.815944 2454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:39:58.818495 2454 webserver.cc:460] Webserver started at http://127.13.139.62:37635/ using document root <none> and password file <none>
I20260810 18:39:58.819183 2454 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:58.819271 2454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:58.819670 2454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:58.822715 2454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "bab08a50a2db46adbe411936f2b82bf2"
format_stamp: "Formatted at 2026-08-10 18:39:58 on dist-test-slave-5k54"
server_key: "a188b5830349ea6a1997222550b65b85"
server_key_iv: "51ade716c0fb66651f4dedadc6fd8812"
server_key_version: "encryptionkey@0"
I20260810 18:39:58.823566 2454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "bab08a50a2db46adbe411936f2b82bf2"
format_stamp: "Formatted at 2026-08-10 18:39:58 on dist-test-slave-5k54"
server_key: "a188b5830349ea6a1997222550b65b85"
server_key_iv: "51ade716c0fb66651f4dedadc6fd8812"
server_key_version: "encryptionkey@0"
I20260810 18:39:58.828904 2454 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:39:58.832520 2470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:58.833956 2454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:39:58.834112 2454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "bab08a50a2db46adbe411936f2b82bf2"
format_stamp: "Formatted at 2026-08-10 18:39:58 on dist-test-slave-5k54"
server_key: "a188b5830349ea6a1997222550b65b85"
server_key_iv: "51ade716c0fb66651f4dedadc6fd8812"
server_key_version: "encryptionkey@0"
I20260810 18:39:58.834304 2454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:58.859575 2454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:58.860422 2454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:58.860682 2454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:58.885385 2454 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:46391
I20260810 18:39:58.885412 2522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:46391 every 8 connection(s)
I20260810 18:39:58.886831 2454 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:39:58.890678 2523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:39:58.893728 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 2454
I20260810 18:39:58.893918 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:39:58.894492 13868 external_mini_cluster.cc:1428] Setting key 8ba29fa92963c04033bd080f7a9c71af
I20260810 18:39:58.903735 2523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2: Bootstrap starting.
I20260810 18:39:58.907529 2523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2: Neither blocks nor log segments found. Creating new log.
I20260810 18:39:58.908749 2523 log.cc:824] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2: Log is configured to *not* fsync() on all Append() calls
I20260810 18:39:58.909265 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:58.896724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.13.139.62:46391)
0810 18:39:58.897810 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:58.897822 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:58.897867 (+ 45us) server_negotiation.cc:407] Connection header received
0810 18:39:58.899751 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:58.899781 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:58.900293 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:58.900645 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:58.901291 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:58.902724 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:58.904669 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:58.905369 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:58.905529 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:58.906785 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:58.906792 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:58.906805 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:58.907315 (+ 510us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:58.907486 (+ 171us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:58.907517 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:58.907608 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:58.907859 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 18:39:58.908223 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":408,"threads_started":1}
I20260810 18:39:58.911921 2523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2: No bootstrap required, opened a new log
I20260810 18:39:58.919489 2523 raft_consensus.cc:348] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab08a50a2db46adbe411936f2b82bf2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46391 } }
I20260810 18:39:58.919891 2523 raft_consensus.cc:374] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:39:58.920018 2523 raft_consensus.cc:729] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab08a50a2db46adbe411936f2b82bf2, State: Initialized, Role: FOLLOWER
I20260810 18:39:58.920656 2523 consensus_queue.cc:260] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab08a50a2db46adbe411936f2b82bf2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46391 } }
I20260810 18:39:58.920921 2523 raft_consensus.cc:388] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:39:58.921079 2523 raft_consensus.cc:482] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:39:58.921254 2523 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:39:58.923614 2523 raft_consensus.cc:504] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab08a50a2db46adbe411936f2b82bf2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46391 } }
I20260810 18:39:58.924223 2523 leader_election.cc:302] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bab08a50a2db46adbe411936f2b82bf2; no voters:
I20260810 18:39:58.924839 2523 leader_election.cc:288] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:39:58.925057 2528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:39:58.925812 2528 raft_consensus.cc:686] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [term 1 LEADER]: Becoming Leader. State: Replica: bab08a50a2db46adbe411936f2b82bf2, State: Running, Role: LEADER
I20260810 18:39:58.926333 2528 consensus_queue.cc:237] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab08a50a2db46adbe411936f2b82bf2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46391 } }
I20260810 18:39:58.926929 2523 sys_catalog.cc:564] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:39:58.929289 2529 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bab08a50a2db46adbe411936f2b82bf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab08a50a2db46adbe411936f2b82bf2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46391 } } }
I20260810 18:39:58.929821 2529 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:58.929415 2530 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab08a50a2db46adbe411936f2b82bf2. Latest consensus state: current_term: 1 leader_uuid: "bab08a50a2db46adbe411936f2b82bf2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab08a50a2db46adbe411936f2b82bf2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46391 } } }
I20260810 18:39:58.930161 2530 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2 [sys.catalog]: This master's current role is: LEADER
I20260810 18:39:58.932272 2538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:39:58.936852 2538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:39:58.945398 2538 catalog_manager.cc:1347] Generated new cluster ID: b8169144278d43cebcddec0b118e9c0f
I20260810 18:39:58.945528 2538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:39:58.959653 2538 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:39:58.961000 2538 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:39:58.983001 2538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2: Generated new TSK 0
I20260810 18:39:58.983974 2538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:39:58.995325 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46391
--builtin_ntp_servers=127.13.139.20:41145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 18:39:59.345945 2549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:59.346230 2549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:59.346390 2549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:59.353685 2549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:59.353791 2549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:59.353957 2549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:39:59.363229 2549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:59.364528 2549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:59.366377 2549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:59.379216 2555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:59.379254 2559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:59.379176 2556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:59.380170 2549 server_base.cc:1034] running on GCE node
I20260810 18:39:59.380785 2549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:59.381719 2549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:59.382967 2549 hybrid_clock.cc:648] HybridClock initialized: now 1786387199382905 us; error 57 us; skew 500 ppm
I20260810 18:39:59.383301 2549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:39:59.385712 2549 webserver.cc:460] Webserver started at http://127.13.139.1:45171/ using document root <none> and password file <none>
I20260810 18:39:59.386413 2549 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:59.386548 2549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:59.386863 2549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:59.389758 2549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "42bc1767ba34432ba5dc41499aeb6f29"
format_stamp: "Formatted at 2026-08-10 18:39:59 on dist-test-slave-5k54"
server_key: "b37288f639fc3da292eba68df6de27b4"
server_key_iv: "198ddc172111a62d437132bbcd9cf558"
server_key_version: "encryptionkey@0"
I20260810 18:39:59.390551 2549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "42bc1767ba34432ba5dc41499aeb6f29"
format_stamp: "Formatted at 2026-08-10 18:39:59 on dist-test-slave-5k54"
server_key: "b37288f639fc3da292eba68df6de27b4"
server_key_iv: "198ddc172111a62d437132bbcd9cf558"
server_key_version: "encryptionkey@0"
I20260810 18:39:59.395869 2549 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 18:39:59.399294 2565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:59.400735 2549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:39:59.400935 2549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "42bc1767ba34432ba5dc41499aeb6f29"
format_stamp: "Formatted at 2026-08-10 18:39:59 on dist-test-slave-5k54"
server_key: "b37288f639fc3da292eba68df6de27b4"
server_key_iv: "198ddc172111a62d437132bbcd9cf558"
server_key_version: "encryptionkey@0"
I20260810 18:39:59.401165 2549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:59.430472 2549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:59.431515 2549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:59.431888 2549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:59.433461 2549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:59.435256 2549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:59.435393 2549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:59.435534 2549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:59.435613 2549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:59.472885 2549 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:42869
I20260810 18:39:59.472944 2687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:42869 every 8 connection(s)
I20260810 18:39:59.474277 2549 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:39:59.477871 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 2549
I20260810 18:39:59.478065 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:39:59.478713 13868 external_mini_cluster.cc:1428] Setting key 9958a2dc13d61788b8c18ca7dcf40d9e
I20260810 18:39:59.482230 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46391
--builtin_ntp_servers=127.13.139.20:41145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 18:39:59.489708 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:59.477038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:35463 (local address 127.13.139.62:46391)
0810 18:39:59.477546 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:59.477552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:59.479049 (+ 1497us) server_negotiation.cc:407] Connection header received
0810 18:39:59.481319 (+ 2270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:59.481323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:59.481385 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:59.481485 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:59.483229 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.484071 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.486666 (+ 2595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.487102 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.487201 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:59.488892 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:59.488897 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:59.488905 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:59.488925 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:59.488996 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:59.489016 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:59.489087 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:59.489369 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 18:39:59.489453 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":231,"threads_started":1}
I20260810 18:39:59.491262 2691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:59.477689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46391 (local address 127.13.139.1:35463)
0810 18:39:59.478851 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:59.478902 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:59.480992 (+ 2090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:59.481794 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:59.481807 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:59.481949 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:59.482798 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:59.482832 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.484239 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.484247 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:59.486494 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:59.486512 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.487342 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.487351 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:59.487709 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:59.488505 (+ 796us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:39:59.488510 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:59.488572 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:39:59.488673 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:59.489115 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:59.489129 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:59.489139 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 18:39:59.489353 (+ 214us) client_negotiation.cc:240] Negotiation successful
0810 18:39:59.489792 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":359,"threads_started":1}
I20260810 18:39:59.492939 2688 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46391
I20260810 18:39:59.493263 2688 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:59.494199 2688 heartbeater.cc:511] Master 127.13.139.62:46391 requested a full tablet report, sending...
I20260810 18:39:59.496454 2488 ts_manager.cc:194] Registered new tserver with Master: 42bc1767ba34432ba5dc41499aeb6f29 (127.13.139.1:42869)
I20260810 18:39:59.497938 2488 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.1:35463
W20260810 18:39:59.820384 2692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:39:59.820798 2692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:39:59.820961 2692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:39:59.831552 2692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:39:59.831655 2692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:39:59.831856 2692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:39:59.842116 2692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:39:59.843528 2692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:39:59.845407 2692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:39:59.858546 2701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:59.858481 2704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:39:59.858592 2700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:39:59.859536 2692 server_base.cc:1034] running on GCE node
I20260810 18:39:59.860183 2692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:39:59.861162 2692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:39:59.862354 2692 hybrid_clock.cc:648] HybridClock initialized: now 1786387199862297 us; error 48 us; skew 500 ppm
I20260810 18:39:59.862689 2692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:39:59.865001 2692 webserver.cc:460] Webserver started at http://127.13.139.2:34649/ using document root <none> and password file <none>
I20260810 18:39:59.865753 2692 fs_manager.cc:359] Metadata directory not provided
I20260810 18:39:59.865890 2692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:39:59.866236 2692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:39:59.869387 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "1397f232b8c649a4a82dcb0fbc1e69b3"
format_stamp: "Formatted at 2026-08-10 18:39:59 on dist-test-slave-5k54"
server_key: "a4e4edec05f2c920fee7bf7b9dfb2455"
server_key_iv: "14dd1afb85502189eef3fb3a08952319"
server_key_version: "encryptionkey@0"
I20260810 18:39:59.870215 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "1397f232b8c649a4a82dcb0fbc1e69b3"
format_stamp: "Formatted at 2026-08-10 18:39:59 on dist-test-slave-5k54"
server_key: "a4e4edec05f2c920fee7bf7b9dfb2455"
server_key_iv: "14dd1afb85502189eef3fb3a08952319"
server_key_version: "encryptionkey@0"
I20260810 18:39:59.875540 2692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260810 18:39:59.879062 2712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:59.880527 2692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:39:59.880702 2692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "1397f232b8c649a4a82dcb0fbc1e69b3"
format_stamp: "Formatted at 2026-08-10 18:39:59 on dist-test-slave-5k54"
server_key: "a4e4edec05f2c920fee7bf7b9dfb2455"
server_key_iv: "14dd1afb85502189eef3fb3a08952319"
server_key_version: "encryptionkey@0"
I20260810 18:39:59.880918 2692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:39:59.900619 2692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:39:59.901443 2692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:39:59.901753 2692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:39:59.902763 2692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:39:59.904291 2692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:39:59.904421 2692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:59.904546 2692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:39:59.904642 2692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:39:59.939175 2692 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:42087
I20260810 18:39:59.939193 2836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:42087 every 8 connection(s)
I20260810 18:39:59.940574 2692 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:39:59.946183 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 2692
I20260810 18:39:59.946374 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:39:59.946951 13868 external_mini_cluster.cc:1428] Setting key 8ecec7c62fd8e30ad4cd9551b7d10e7f
I20260810 18:39:59.950235 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46391
--builtin_ntp_servers=127.13.139.20:41145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 18:39:59.954736 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:59.943238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:39113 (local address 127.13.139.62:46391)
0810 18:39:59.943522 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 18:39:59.943526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:39:59.944970 (+ 1444us) server_negotiation.cc:407] Connection header received
0810 18:39:59.947290 (+ 2320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:39:59.947295 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:39:59.947363 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:39:59.947506 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:39:59.948683 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.949507 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.951969 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.952375 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.952472 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:59.954037 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:39:59.954042 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:39:59.954045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:39:59.954061 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:39:59.954092 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:39:59.954104 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:39:59.954170 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 18:39:59.954443 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 18:39:59.954520 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260810 18:39:59.956189 2839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:39:59.943909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46391 (local address 127.13.139.2:39113)
0810 18:39:59.944808 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0810 18:39:59.944850 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 18:39:59.946974 (+ 2124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:39:59.947730 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:39:59.947738 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:39:59.947821 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:39:59.948524 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:59.948546 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.949661 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.949666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:59.951826 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:39:59.951844 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:39:59.952593 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:39:59.952602 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:39:59.952920 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:39:59.953684 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:39:59.953690 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:39:59.953741 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:39:59.953847 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:39:59.954197 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:39:59.954209 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:39:59.954220 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 18:39:59.954427 (+ 207us) client_negotiation.cc:240] Negotiation successful
0810 18:39:59.954823 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":275,"threads_started":1}
I20260810 18:39:59.957607 2837 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46391
I20260810 18:39:59.957914 2837 heartbeater.cc:464] Registering TS with master...
I20260810 18:39:59.958807 2837 heartbeater.cc:511] Master 127.13.139.62:46391 requested a full tablet report, sending...
I20260810 18:39:59.960291 2488 ts_manager.cc:194] Registered new tserver with Master: 1397f232b8c649a4a82dcb0fbc1e69b3 (127.13.139.2:42087)
I20260810 18:39:59.961114 2488 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.2:39113
W20260810 18:40:00.287895 2840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:00.288174 2840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:00.288260 2840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:00.295477 2840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:00.295612 2840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:00.295720 2840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:40:00.304731 2840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:46391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:00.306020 2840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:00.307889 2840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:00.320962 2848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:00.321022 2846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:00.321058 2845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:00.321899 2840 server_base.cc:1034] running on GCE node
I20260810 18:40:00.322510 2840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:00.323473 2840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:00.324716 2840 hybrid_clock.cc:648] HybridClock initialized: now 1786387200324686 us; error 37 us; skew 500 ppm
I20260810 18:40:00.325064 2840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:40:00.327369 2840 webserver.cc:460] Webserver started at http://127.13.139.3:35327/ using document root <none> and password file <none>
I20260810 18:40:00.328191 2840 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:00.328322 2840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:00.328637 2840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:00.331812 2840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42"
format_stamp: "Formatted at 2026-08-10 18:40:00 on dist-test-slave-5k54"
server_key: "e1da790e06d73b395d7ab10e9bd3170e"
server_key_iv: "08005f8803175b22ab9efbfc7926c28a"
server_key_version: "encryptionkey@0"
I20260810 18:40:00.332701 2840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42"
format_stamp: "Formatted at 2026-08-10 18:40:00 on dist-test-slave-5k54"
server_key: "e1da790e06d73b395d7ab10e9bd3170e"
server_key_iv: "08005f8803175b22ab9efbfc7926c28a"
server_key_version: "encryptionkey@0"
I20260810 18:40:00.337879 2840 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260810 18:40:00.341600 2854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:00.342878 2840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 18:40:00.343119 2840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42"
format_stamp: "Formatted at 2026-08-10 18:40:00 on dist-test-slave-5k54"
server_key: "e1da790e06d73b395d7ab10e9bd3170e"
server_key_iv: "08005f8803175b22ab9efbfc7926c28a"
server_key_version: "encryptionkey@0"
I20260810 18:40:00.343362 2840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:00.367774 2840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:00.368584 2840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:00.368892 2840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:00.369869 2840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:40:00.371289 2840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:40:00.371414 2840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:00.371577 2840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:40:00.371673 2840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:00.405393 2840 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:46859
I20260810 18:40:00.405458 2990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:46859 every 8 connection(s)
I20260810 18:40:00.406733 2840 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:40:00.412914 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 2840
I20260810 18:40:00.413107 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:40:00.413647 13868 external_mini_cluster.cc:1428] Setting key cbf053242cfd111377509b24b1f93d24
I20260810 18:40:00.419610 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.409374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:59841 (local address 127.13.139.62:46391)
0810 18:40:00.409601 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.409607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.411304 (+ 1697us) server_negotiation.cc:407] Connection header received
0810 18:40:00.412983 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.412991 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.413094 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.413211 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:00.414291 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.415215 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.416824 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.417245 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.417389 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.418723 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:00.418727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:00.418731 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:00.418749 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:00.418781 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:00.418793 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:00.418888 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.419117 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.419224 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 18:40:00.420707 2994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.409925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:46391 (local address 127.13.139.3:59841)
0810 18:40:00.410970 (+ 1045us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.411020 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:00.412709 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:00.413425 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:00.413433 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:00.413536 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:00.414122 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.414139 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.415367 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.415377 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.416671 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.416684 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.417500 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.417509 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.417744 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.418392 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:40:00.418395 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:00.418435 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:40:00.418526 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:00.418890 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:00.418904 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:00.418914 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 18:40:00.419103 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 18:40:00.419554 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":264,"threads_started":1}
I20260810 18:40:00.422331 2991 heartbeater.cc:347] Connected to a master server at 127.13.139.62:46391
I20260810 18:40:00.422648 2991 heartbeater.cc:464] Registering TS with master...
I20260810 18:40:00.423394 2991 heartbeater.cc:511] Master 127.13.139.62:46391 requested a full tablet report, sending...
I20260810 18:40:00.424888 2488 ts_manager.cc:194] Registered new tserver with Master: 6c11f7ce54bf4ac5a95b62ef01b94e42 (127.13.139.3:46859)
I20260810 18:40:00.425688 2488 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.3:59841
I20260810 18:40:00.429008 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:40:00.439337 2690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.433327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33620 (local address 127.13.139.62:46391)
0810 18:40:00.433484 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.433488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.434020 (+ 532us) server_negotiation.cc:407] Connection header received
0810 18:40:00.434153 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.434156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.434212 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.434291 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:00.434695 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.435390 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.436768 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.437155 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.437245 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.438485 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:00.438490 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:00.438493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:00.438510 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:00.438539 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:00.438550 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:00.438752 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.438967 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.439026 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 18:40:00.443825 2488 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:40:00.450834 2488 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:40:00.472558 3006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.462789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:42087 (local address 127.0.0.1:60194)
0810 18:40:00.463835 (+ 1046us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.463870 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:00.464046 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:00.464828 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:00.464840 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:00.464886 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:00.465408 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.465425 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.467584 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.467590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.469586 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.469600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.471399 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.471412 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.471685 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.471736 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 18:40:00.471857 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 18:40:00.472051 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"mutex_wait_us":67,"thread_start_us":646,"threads_started":1}
I20260810 18:40:00.473779 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.464253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58696)
0810 18:40:00.464824 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.464844 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:00.464971 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:00.466120 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:00.466128 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:00.466157 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:00.466624 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.466640 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.468468 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.468476 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.470749 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.470774 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.472647 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.472653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.472824 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.472853 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 18:40:00.472921 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 18:40:00.473414 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":27,"thread_start_us":272,"threads_started":1}
I20260810 18:40:00.474859 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.465707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:46859 (local address 127.0.0.1:52264)
0810 18:40:00.466834 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.466849 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:00.466974 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:00.467631 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:00.467639 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:00.467665 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:00.468044 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.468056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.470045 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.470050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.472051 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.472064 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.474237 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.474244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.474413 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.474448 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:40:00.474527 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 18:40:00.474623 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1008,"mutex_wait_us":23,"thread_start_us":856,"threads_started":1}
I20260810 18:40:00.474932 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.464531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58696 (local address 127.13.139.1:42869)
0810 18:40:00.465484 (+ 953us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.465494 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.465526 (+ 32us) server_negotiation.cc:407] Connection header received
0810 18:40:00.465646 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.465653 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.465869 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.466150 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:00.466853 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.468328 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.470974 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.472408 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.474039 (+ 1631us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.474295 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.474360 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.474527 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":796,"thread_start_us":683,"threads_started":1}
I20260810 18:40:00.475687 3010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.465240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52264 (local address 127.13.139.3:46859)
0810 18:40:00.466015 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.466025 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.467089 (+ 1064us) server_negotiation.cc:407] Connection header received
0810 18:40:00.467195 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.467203 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.467398 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.467610 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:00.468214 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.469868 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.472267 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.473705 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.473831 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.474113 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.475159 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.475324 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":583,"threads_started":1}
I20260810 18:40:00.478825 2913 tablet_service.cc:1467] Processing CreateTablet for tablet 096e41d456cb41df92dcee477283604e (DEFAULT_TABLE table=test-table [id=59e4caf69b44493a89cd722d1d013d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:00.478305 2617 tablet_service.cc:1467] Processing CreateTablet for tablet 096e41d456cb41df92dcee477283604e (DEFAULT_TABLE table=test-table [id=59e4caf69b44493a89cd722d1d013d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:00.480325 2913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096e41d456cb41df92dcee477283604e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:00.480346 2617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096e41d456cb41df92dcee477283604e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:00.482272 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.463099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60194 (local address 127.13.139.2:42087)
0810 18:40:00.463747 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.463754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.463987 (+ 233us) server_negotiation.cc:407] Connection header received
0810 18:40:00.464259 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.464267 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.464525 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.465508 (+ 983us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:00.465802 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.467376 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.469824 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.471192 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.471330 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.471620 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.471921 (+ 301us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.482015 (+ 10094us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":407,"threads_started":1}
I20260810 18:40:00.485872 2763 tablet_service.cc:1467] Processing CreateTablet for tablet 096e41d456cb41df92dcee477283604e (DEFAULT_TABLE table=test-table [id=59e4caf69b44493a89cd722d1d013d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:00.487280 2763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 096e41d456cb41df92dcee477283604e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:00.493366 3012 tablet_bootstrap.cc:492] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: Bootstrap starting.
I20260810 18:40:00.495362 3014 tablet_bootstrap.cc:492] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Bootstrap starting.
I20260810 18:40:00.497556 3012 tablet_bootstrap.cc:654] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:00.498857 3012 log.cc:824] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:00.498924 3014 tablet_bootstrap.cc:654] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:00.500072 3014 log.cc:824] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:00.500892 2688 heartbeater.cc:503] Master 127.13.139.62:46391 was elected leader, sending a full tablet report...
I20260810 18:40:00.502187 3012 tablet_bootstrap.cc:492] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: No bootstrap required, opened a new log
I20260810 18:40:00.502529 3012 ts_tablet_manager.cc:1397] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260810 18:40:00.504585 3014 tablet_bootstrap.cc:492] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: No bootstrap required, opened a new log
I20260810 18:40:00.504956 3014 ts_tablet_manager.cc:1397] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260810 18:40:00.507262 3017 tablet_bootstrap.cc:492] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Bootstrap starting.
I20260810 18:40:00.510125 3017 tablet_bootstrap.cc:654] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:00.511574 3017 log.cc:824] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:00.514284 3017 tablet_bootstrap.cc:492] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: No bootstrap required, opened a new log
I20260810 18:40:00.514559 3017 ts_tablet_manager.cc:1397] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 18:40:00.515275 3012 raft_consensus.cc:348] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.516206 3012 raft_consensus.cc:374] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:00.516208 3014 raft_consensus.cc:348] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.516664 3014 raft_consensus.cc:374] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:00.516769 3014 raft_consensus.cc:729] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c11f7ce54bf4ac5a95b62ef01b94e42, State: Initialized, Role: FOLLOWER
I20260810 18:40:00.516396 3012 raft_consensus.cc:729] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc1767ba34432ba5dc41499aeb6f29, State: Initialized, Role: FOLLOWER
I20260810 18:40:00.517614 3012 consensus_queue.cc:260] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.517614 3014 consensus_queue.cc:260] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.519273 2991 heartbeater.cc:503] Master 127.13.139.62:46391 was elected leader, sending a full tablet report...
I20260810 18:40:00.519850 3012 ts_tablet_manager.cc:1428] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
I20260810 18:40:00.520697 3014 ts_tablet_manager.cc:1428] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Time spent starting tablet: real 0.015s user 0.012s sys 0.001s
I20260810 18:40:00.524590 3017 raft_consensus.cc:348] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.524951 3017 raft_consensus.cc:374] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:00.525024 3017 raft_consensus.cc:729] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1397f232b8c649a4a82dcb0fbc1e69b3, State: Initialized, Role: FOLLOWER
I20260810 18:40:00.525497 3017 consensus_queue.cc:260] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.526440 2837 heartbeater.cc:503] Master 127.13.139.62:46391 was elected leader, sending a full tablet report...
I20260810 18:40:00.527066 3017 ts_tablet_manager.cc:1428] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260810 18:40:00.658490 2993 tablet.cc:2369] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:00.671186 3021 raft_consensus.cc:482] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:40:00.671567 3021 raft_consensus.cc:504] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.673238 3021 leader_election.cc:288] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1397f232b8c649a4a82dcb0fbc1e69b3 (127.13.139.2:42087), 6c11f7ce54bf4ac5a95b62ef01b94e42 (127.13.139.3:46859)
I20260810 18:40:00.679840 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.673860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:37295 (local address 127.13.139.2:42087)
0810 18:40:00.674054 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.674059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.674471 (+ 412us) server_negotiation.cc:407] Connection header received
0810 18:40:00.674719 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.674725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.674821 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.674933 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:00.675635 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.676339 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.678125 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.678916 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.679117 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.679190 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.679458 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.679579 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 18:40:00.679953 3023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.673689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:42087 (local address 127.13.139.1:37295)
0810 18:40:00.674360 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.674382 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:00.674552 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:00.675076 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:00.675082 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:00.675115 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:00.675494 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.675504 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.676477 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.676485 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.677941 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.677952 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.679117 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.679123 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.679279 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.679303 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 18:40:00.679408 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 18:40:00.679572 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":1,"thread_start_us":347,"threads_started":1}
I20260810 18:40:00.680431 3010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.674762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:49261 (local address 127.13.139.3:46859)
0810 18:40:00.674979 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.674985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.675246 (+ 261us) server_negotiation.cc:407] Connection header received
0810 18:40:00.675505 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.675511 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.675571 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.675669 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:00.676183 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.676876 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.678617 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.679372 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.679649 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.679716 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.680058 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.680179 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:40:00.680994 3024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.674513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:46859 (local address 127.13.139.1:49261)
0810 18:40:00.675136 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.675150 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:00.675312 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:00.675683 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:00.675688 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:00.675710 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:00.676036 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.676044 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.677023 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.677029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.678435 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:00.678453 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.679662 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.679668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:00.679836 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.679860 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 18:40:00.680619 (+ 759us) client_negotiation.cc:240] Negotiation successful
0810 18:40:00.680757 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":25,"thread_start_us":326,"threads_started":1}
I20260810 18:40:00.681125 2786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e41d456cb41df92dcee477283604e" candidate_uuid: "42bc1767ba34432ba5dc41499aeb6f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" is_pre_election: true
I20260810 18:40:00.681731 2786 raft_consensus.cc:2454] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc1767ba34432ba5dc41499aeb6f29 in term 0.
I20260810 18:40:00.682116 2937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e41d456cb41df92dcee477283604e" candidate_uuid: "42bc1767ba34432ba5dc41499aeb6f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" is_pre_election: true
I20260810 18:40:00.682492 2566 leader_election.cc:302] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1397f232b8c649a4a82dcb0fbc1e69b3, 42bc1767ba34432ba5dc41499aeb6f29; no voters:
I20260810 18:40:00.682721 2937 raft_consensus.cc:2454] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc1767ba34432ba5dc41499aeb6f29 in term 0.
I20260810 18:40:00.682924 3021 raft_consensus.cc:2781] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:40:00.683084 3021 raft_consensus.cc:482] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:40:00.683202 3021 raft_consensus.cc:3037] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:00.685577 3021 raft_consensus.cc:504] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
I20260810 18:40:00.686177 3021 leader_election.cc:288] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [CANDIDATE]: Term 1 election: Requested vote from peers 1397f232b8c649a4a82dcb0fbc1e69b3 (127.13.139.2:42087), 6c11f7ce54bf4ac5a95b62ef01b94e42 (127.13.139.3:46859)
I20260810 18:40:00.686586 2786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e41d456cb41df92dcee477283604e" candidate_uuid: "42bc1767ba34432ba5dc41499aeb6f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3"
I20260810 18:40:00.686679 2937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "096e41d456cb41df92dcee477283604e" candidate_uuid: "42bc1767ba34432ba5dc41499aeb6f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42"
I20260810 18:40:00.686769 2786 raft_consensus.cc:3037] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:00.686919 2937 raft_consensus.cc:3037] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:00.689073 2786 raft_consensus.cc:2454] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc1767ba34432ba5dc41499aeb6f29 in term 1.
I20260810 18:40:00.689122 2937 raft_consensus.cc:2454] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc1767ba34432ba5dc41499aeb6f29 in term 1.
I20260810 18:40:00.689443 2566 leader_election.cc:302] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1397f232b8c649a4a82dcb0fbc1e69b3, 42bc1767ba34432ba5dc41499aeb6f29; no voters:
I20260810 18:40:00.689755 3021 raft_consensus.cc:2781] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:00.690193 3021 raft_consensus.cc:686] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 1 LEADER]: Becoming Leader. State: Replica: 42bc1767ba34432ba5dc41499aeb6f29, State: Running, Role: LEADER
I20260810 18:40:00.690659 3021 consensus_queue.cc:237] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } }
W20260810 18:40:00.692560 2838 tablet.cc:2369] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:00.695492 2488 catalog_manager.cc:5495] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42bc1767ba34432ba5dc41499aeb6f29 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "42bc1767ba34432ba5dc41499aeb6f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc1767ba34432ba5dc41499aeb6f29" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 42869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 } health_report { overall_health: UNKNOWN } } }
I20260810 18:40:00.714956 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.709587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58710 (local address 127.13.139.1:42869)
0810 18:40:00.709793 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.709798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.709815 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:40:00.710004 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.710008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.710099 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.710236 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:00.710610 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.711387 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.712825 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.713235 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.713337 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.713819 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:00.714289 (+ 470us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:00.714426 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.714558 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.714623 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 18:40:00.723134 2937 raft_consensus.cc:1261] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 1 FOLLOWER]: Refusing update from remote peer 42bc1767ba34432ba5dc41499aeb6f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:00.723127 2786 raft_consensus.cc:1261] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 1 FOLLOWER]: Refusing update from remote peer 42bc1767ba34432ba5dc41499aeb6f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:00.724150 3025 consensus_queue.cc:1035] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c11f7ce54bf4ac5a95b62ef01b94e42" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 46859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:00.724572 3021 consensus_queue.cc:1035] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1397f232b8c649a4a82dcb0fbc1e69b3" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 42087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 18:40:00.726871 2689 tablet.cc:2369] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:00.739125 3031 mvcc.cc:205] Tried to move back new op lower bound from 7317041974151757824 to 7317041974032871424. Current Snapshot: MvccSnapshot[applied={T|T < 7317041974151757824}]
I20260810 18:40:00.749619 2488 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:40:00.749887 2488 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:40:00.753369 2488 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bab08a50a2db46adbe411936f2b82bf2: Sending DeleteTablet for 3 replicas of tablet 096e41d456cb41df92dcee477283604e
I20260810 18:40:00.754551 2617 tablet_service.cc:1514] Processing DeleteTablet for tablet 096e41d456cb41df92dcee477283604e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:00 UTC) from {username='slave'} at 127.0.0.1:58696
I20260810 18:40:00.754544 2763 tablet_service.cc:1514] Processing DeleteTablet for tablet 096e41d456cb41df92dcee477283604e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:00 UTC) from {username='slave'} at 127.0.0.1:60194
I20260810 18:40:00.755232 2913 tablet_service.cc:1514] Processing DeleteTablet for tablet 096e41d456cb41df92dcee477283604e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:00 UTC) from {username='slave'} at 127.0.0.1:52264
I20260810 18:40:00.756312 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 2549
I20260810 18:40:00.768266 3041 tablet_replica.cc:330] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: stopping tablet replica
I20260810 18:40:00.768937 3040 tablet_replica.cc:330] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: stopping tablet replica
I20260810 18:40:00.769731 3040 raft_consensus.cc:2229] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:40:00.770375 3041 raft_consensus.cc:2229] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:40:00.771108 3041 raft_consensus.cc:2258] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:00.771999 3042 tablet_replica.cc:330] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: stopping tablet replica
I20260810 18:40:00.772042 3040 raft_consensus.cc:2258] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:00.772464 3042 raft_consensus.cc:2229] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:40:00.772967 3042 raft_consensus.cc:2258] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:00.774122 3041 ts_tablet_manager.cc:1905] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:00.774115 3040 ts_tablet_manager.cc:1905] T 096e41d456cb41df92dcee477283604e P 42bc1767ba34432ba5dc41499aeb6f29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:00.775019 3042 ts_tablet_manager.cc:1905] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:00.777817 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.757542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58726 (local address 127.13.139.1:42869)
0810 18:40:00.757770 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.757780 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.763989 (+ 6209us) server_negotiation.cc:407] Connection header received
0810 18:40:00.764873 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.764880 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.764982 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.765086 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:00.765719 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.766933 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.768947 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.769626 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.769735 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.776063 (+ 6328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:00.776074 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:00.776090 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:00.776799 (+ 709us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:00.776923 (+ 124us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:00.776956 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:00.777037 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.777317 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.777419 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:40:00.779049 2683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:00.781733 3041 ts_tablet_manager.cc:1918] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:40:00.781914 3041 log.cc:1196] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/096e41d456cb41df92dcee477283604e
I20260810 18:40:00.782423 3041 ts_tablet_manager.cc:1939] T 096e41d456cb41df92dcee477283604e P 1397f232b8c649a4a82dcb0fbc1e69b3: Deleting consensus metadata
I20260810 18:40:00.783092 3042 ts_tablet_manager.cc:1918] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:40:00.783288 3042 log.cc:1196] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/096e41d456cb41df92dcee477283604e
I20260810 18:40:00.784224 3042 ts_tablet_manager.cc:1939] T 096e41d456cb41df92dcee477283604e P 6c11f7ce54bf4ac5a95b62ef01b94e42: Deleting consensus metadata
I20260810 18:40:00.784372 2471 catalog_manager.cc:4841] TS 1397f232b8c649a4a82dcb0fbc1e69b3 (127.13.139.2:42087): tablet 096e41d456cb41df92dcee477283604e (table test-table [id=59e4caf69b44493a89cd722d1d013d77]) successfully deleted
I20260810 18:40:00.786300 2471 catalog_manager.cc:4841] TS 6c11f7ce54bf4ac5a95b62ef01b94e42 (127.13.139.3:46859): tablet 096e41d456cb41df92dcee477283604e (table test-table [id=59e4caf69b44493a89cd722d1d013d77]) successfully deleted
I20260810 18:40:00.887660 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 2549
W20260810 18:40:00.918089 2471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:42869 (error 108)
I20260810 18:40:00.918941 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 2692
I20260810 18:40:00.920184 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.919661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58738)
0810 18:40:00.919829 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.919985 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 18:40:00.920423 2471 catalog_manager.cc:4584] TS 42bc1767ba34432ba5dc41499aeb6f29 (127.13.139.1:42869): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 096e41d456cb41df92dcee477283604e: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
I20260810 18:40:00.926007 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.919771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60210 (local address 127.13.139.2:42087)
0810 18:40:00.919939 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:00.919946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:00.920053 (+ 107us) server_negotiation.cc:407] Connection header received
0810 18:40:00.920187 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:00.920194 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:00.920311 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:00.920457 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:00.920873 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.921619 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.922965 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:00.923378 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:00.923600 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:00.924641 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:00.924649 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:00.924662 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:00.925226 (+ 564us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:00.925275 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:00.925295 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:00.925427 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:00.925543 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 18:40:00.925645 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:40:00.926673 2832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:00.974212 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.973669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58742)
0810 18:40:00.973873 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.973977 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260810 18:40:00.975312 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:00.974945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58756)
0810 18:40:00.975106 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:00.975192 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 18:40:01.019630 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 2692
I20260810 18:40:01.035769 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:01.035270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58770)
0810 18:40:01.035500 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:01.035592 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 18:40:01.036818 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:01.036478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58772)
0810 18:40:01.036631 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:01.036706 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 18:40:01.040125 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 2840
I20260810 18:40:01.046900 3010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:01.040872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52278 (local address 127.13.139.3:46859)
0810 18:40:01.041070 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:01.041076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:01.041097 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:40:01.041268 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:01.041276 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:01.041366 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:01.041485 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:01.041885 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:01.042611 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:01.043968 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:01.044361 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:01.044506 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:01.045557 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:01.045566 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:01.045581 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:01.046133 (+ 552us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:01.046181 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:01.046200 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:01.046322 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:01.046482 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 18:40:01.046588 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:40:01.047578 2985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:01.118238 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:01.117720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58778)
0810 18:40:01.117954 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:01.118055 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260810 18:40:01.119304 3011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:01.118948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:42869 (local address 127.0.0.1:58792)
0810 18:40:01.119132 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:01.119202 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260810 18:40:01.136874 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 2840
I20260810 18:40:01.157253 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 2454
I20260810 18:40:01.158430 2518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:01.269323 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 2454
2026-08-10T18:40:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2934 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:01 dist-test-slave-5k54 krb5kdc[3052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:01 dist-test-slave-5k54 krb5kdc[3052](info): set up 2 sockets
Aug 10 18:40:01 dist-test-slave-5k54 krb5kdc[3052](info): commencing operation
krb5kdc: starting...
W20260810 18:40:02.451838 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:02 dist-test-slave-5k54 krb5kdc[3052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:02.766465 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33495
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:33495
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:03.111084 3067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:03.111403 3067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:03.111583 3067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:03.119233 3067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:03.119365 3067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:03.119415 3067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:03.119598 3067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:03.119652 3067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:03.129873 3067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:33495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:03.131227 3067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:03.132596 3067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:03.144701 3075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:03.144789 3073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:03.144801 3072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:03.145473 3067 server_base.cc:1034] running on GCE node
I20260810 18:40:03.146265 3067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:03.147650 3067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:03.148859 3067 hybrid_clock.cc:648] HybridClock initialized: now 1786387203148788 us; error 59 us; skew 500 ppm
I20260810 18:40:03.149209 3067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:03 dist-test-slave-5k54 krb5kdc[3052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387203, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:03.152323 3067 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:03.153699 3067 webserver.cc:460] Webserver started at http://127.13.139.62:33719/ using document root <none> and password file <none>
I20260810 18:40:03.154407 3067 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:03.154542 3067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:03.154862 3067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:03.157971 3067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "b54694ee5de046e3879e7d9bbf8ca5a3"
format_stamp: "Formatted at 2026-08-10 18:40:03 on dist-test-slave-5k54"
server_key: "7c7a16ab3aa3adba0358fdc7b94d0f57"
server_key_iv: "1ff392aa0f7307a75250c7f71de61dd0"
server_key_version: "encryptionkey@0"
I20260810 18:40:03.158717 3067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "b54694ee5de046e3879e7d9bbf8ca5a3"
format_stamp: "Formatted at 2026-08-10 18:40:03 on dist-test-slave-5k54"
server_key: "7c7a16ab3aa3adba0358fdc7b94d0f57"
server_key_iv: "1ff392aa0f7307a75250c7f71de61dd0"
server_key_version: "encryptionkey@0"
I20260810 18:40:03.163902 3067 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260810 18:40:03.167375 3083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:03.168711 3067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:03.168987 3067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "b54694ee5de046e3879e7d9bbf8ca5a3"
format_stamp: "Formatted at 2026-08-10 18:40:03 on dist-test-slave-5k54"
server_key: "7c7a16ab3aa3adba0358fdc7b94d0f57"
server_key_iv: "1ff392aa0f7307a75250c7f71de61dd0"
server_key_version: "encryptionkey@0"
I20260810 18:40:03.169209 3067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:03.188129 3067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:03.191977 3067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:03.192267 3067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:03.210981 3067 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:33495
I20260810 18:40:03.211005 3138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:33495 every 8 connection(s)
I20260810 18:40:03.212441 3067 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:03.216328 3139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:03.217221 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 3067
I20260810 18:40:03.217450 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:03.217991 13868 external_mini_cluster.cc:1428] Setting key 56503c81108987902972d7ed9367257d
I20260810 18:40:03.230726 3139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3: Bootstrap starting.
I20260810 18:40:03.233739 3139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3: Neither blocks nor log segments found. Creating new log.
Aug 10 18:40:03 dist-test-slave-5k54 krb5kdc[3052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:03.234818 3139 log.cc:824] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:03.238037 3139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3: No bootstrap required, opened a new log
I20260810 18:40:03.242846 3142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:03.220139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37614 (local address 127.13.139.62:33495)
0810 18:40:03.221049 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:03.221065 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:03.221115 (+ 50us) server_negotiation.cc:407] Connection header received
0810 18:40:03.223070 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:03.223098 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:03.223656 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:03.224097 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:03.225853 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:03.227934 (+ 2081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:03.229346 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:03.230412 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:03.230604 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:03.235136 (+ 4532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:03.235144 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:03.235158 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:03.235198 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:03.238633 (+ 3435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:03.239401 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:03.239407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:03.239413 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:03.239652 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:03.240061 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:03.240068 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:03.240076 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:03.240600 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:03.240987 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:03.241423 (+ 436us) server_negotiation.cc:299] Negotiation successful
0810 18:40:03.241846 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":404,"threads_started":1}
I20260810 18:40:03.246217 3139 raft_consensus.cc:348] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33495 } }
I20260810 18:40:03.246590 3139 raft_consensus.cc:374] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:03.246698 3139 raft_consensus.cc:729] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54694ee5de046e3879e7d9bbf8ca5a3, State: Initialized, Role: FOLLOWER
I20260810 18:40:03.247339 3139 consensus_queue.cc:260] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33495 } }
I20260810 18:40:03.247648 3139 raft_consensus.cc:388] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:03.247799 3139 raft_consensus.cc:482] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:03.247987 3139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:03.250392 3139 raft_consensus.cc:504] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33495 } }
I20260810 18:40:03.250818 3139 leader_election.cc:302] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b54694ee5de046e3879e7d9bbf8ca5a3; no voters:
I20260810 18:40:03.251386 3139 leader_election.cc:288] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:03.251624 3144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:03.252451 3144 raft_consensus.cc:686] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [term 1 LEADER]: Becoming Leader. State: Replica: b54694ee5de046e3879e7d9bbf8ca5a3, State: Running, Role: LEADER
I20260810 18:40:03.252986 3144 consensus_queue.cc:237] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33495 } }
I20260810 18:40:03.253567 3139 sys_catalog.cc:564] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:03.256301 3146 sys_catalog.cc:455] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b54694ee5de046e3879e7d9bbf8ca5a3. Latest consensus state: current_term: 1 leader_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33495 } } }
I20260810 18:40:03.256593 3145 sys_catalog.cc:455] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54694ee5de046e3879e7d9bbf8ca5a3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33495 } } }
I20260810 18:40:03.256932 3145 sys_catalog.cc:458] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:03.256929 3146 sys_catalog.cc:458] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:03.260841 3151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:03.266355 3151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:03.275897 3151 catalog_manager.cc:1347] Generated new cluster ID: 09c7a466af5a4578b09019cedbf96bac
I20260810 18:40:03.276027 3151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:03.288826 3151 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:03.290452 3151 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:03.304339 3151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3: Generated new TSK 0
I20260810 18:40:03.305167 3151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.139.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
Entry for principal kudu/127.13.139.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab.
I20260810 18:40:03.384138 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33495
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:03.731092 3166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:03.731385 3166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:03.731585 3166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:03.738844 3166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:03.738952 3166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:03.739171 3166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:40:03.749074 3166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.1.keytab
--principal=kudu/127.13.139.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33495
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:03.750346 3166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:03.751688 3166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:03.765349 3171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:03.765314 3174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:03.765349 3172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:03.766260 3166 server_base.cc:1034] running on GCE node
I20260810 18:40:03.766911 3166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:03.767985 3166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:03.769181 3166 hybrid_clock.cc:648] HybridClock initialized: now 1786387203769146 us; error 25 us; skew 500 ppm
I20260810 18:40:03.769503 3166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:03 dist-test-slave-5k54 krb5kdc[3052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387203, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:03.772969 3166 init.cc:377] Logged in from keytab as kudu/127.13.139.1@KRBTEST.COM (short username kudu)
I20260810 18:40:03.774523 3166 webserver.cc:460] Webserver started at http://127.13.139.1:34825/ using document root <none> and password file <none>
I20260810 18:40:03.775271 3166 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:03.775413 3166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:03.775768 3166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:03.778687 3166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "23af67b496bb446b969f3c4196053c84"
format_stamp: "Formatted at 2026-08-10 18:40:03 on dist-test-slave-5k54"
server_key: "8838079213b13ffcd8adf489b467e845"
server_key_iv: "8cf7c4ad2d7fbd66c726d4ef7e9e385c"
server_key_version: "encryptionkey@0"
I20260810 18:40:03.779505 3166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "23af67b496bb446b969f3c4196053c84"
format_stamp: "Formatted at 2026-08-10 18:40:03 on dist-test-slave-5k54"
server_key: "8838079213b13ffcd8adf489b467e845"
server_key_iv: "8cf7c4ad2d7fbd66c726d4ef7e9e385c"
server_key_version: "encryptionkey@0"
I20260810 18:40:03.784863 3166 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 18:40:03.788262 3181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:03.789542 3166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:03.789721 3166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "23af67b496bb446b969f3c4196053c84"
format_stamp: "Formatted at 2026-08-10 18:40:03 on dist-test-slave-5k54"
server_key: "8838079213b13ffcd8adf489b467e845"
server_key_iv: "8cf7c4ad2d7fbd66c726d4ef7e9e385c"
server_key_version: "encryptionkey@0"
I20260810 18:40:03.789955 3166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:03.802289 3166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:03.806272 3166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:03.806563 3166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:03.807536 3166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:40:03.808789 3166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:40:03.808894 3166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:03.809053 3166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:40:03.809132 3166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:03.843356 3166 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:45547
I20260810 18:40:03.843411 3308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:45547 every 8 connection(s)
I20260810 18:40:03.844666 3166 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:40:03.846580 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 3166
I20260810 18:40:03.846768 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:40:03.847460 13868 external_mini_cluster.cc:1428] Setting key a2122db8399b15d6f287dea39e4dc26f
Aug 10 18:40:03 dist-test-slave-5k54 krb5kdc[3052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387203, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.1@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:03.866932 3311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:03.847632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:57179 (local address 127.13.139.62:33495)
0810 18:40:03.848131 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:03.848137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:03.849468 (+ 1331us) server_negotiation.cc:407] Connection header received
0810 18:40:03.851266 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:03.851274 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:03.851364 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:03.851504 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:03.852982 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:03.854134 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:03.855897 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:03.856609 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:03.856756 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:03.860321 (+ 3565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:03.860330 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:03.860338 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:03.860384 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:03.863664 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:03.864602 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:03.864606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:03.864608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:03.864725 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:03.865214 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:03.865217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:03.865219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:03.865473 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:03.865581 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:03.866464 (+ 883us) server_negotiation.cc:299] Negotiation successful
0810 18:40:03.866645 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":261,"threads_started":1}
I20260810 18:40:03.868458 3312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:03.848233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33495 (local address 127.13.139.1:57179)
0810 18:40:03.849181 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:03.849232 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:03.851001 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:03.851707 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:03.851715 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:03.852234 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:03.852810 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:03.852828 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:03.854297 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:03.854301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:03.855754 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:03.855766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:03.856813 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:03.856818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:03.857012 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:03.857692 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:03.857713 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:03.860096 (+ 2383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:03.863803 (+ 3707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:03.863814 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:03.863832 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:03.864477 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:03.864844 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:03.864851 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:03.864858 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:03.865106 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:03.865596 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:03.865606 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:03.866030 (+ 424us) client_negotiation.cc:769] Sending connection context
0810 18:40:03.866319 (+ 289us) client_negotiation.cc:240] Negotiation successful
0810 18:40:03.866924 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":352,"threads_started":1}
I20260810 18:40:03.870249 3309 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33495
I20260810 18:40:03.870577 3309 heartbeater.cc:464] Registering TS with master...
I20260810 18:40:03.871320 3309 heartbeater.cc:511] Master 127.13.139.62:33495 requested a full tablet report, sending...
I20260810 18:40:03.873590 3102 ts_manager.cc:194] Registered new tserver with Master: 23af67b496bb446b969f3c4196053c84 (127.13.139.1:45547)
I20260810 18:40:03.875085 3102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.1@KRBTEST.COM'} at 127.13.139.1:57179
WARNING: no policy specified for kudu/127.13.139.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
Entry for principal kudu/127.13.139.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab.
I20260810 18:40:03.921137 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33495
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:04.259984 3315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:04.260315 3315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:04.260541 3315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:04.267910 3315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:04.268021 3315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:04.268196 3315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:40:04.278283 3315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.2.keytab
--principal=kudu/127.13.139.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33495
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:04.279647 3315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:04.280973 3315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:04.294171 3320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:04.294193 3321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:04.294746 3323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:04.295765 3315 server_base.cc:1034] running on GCE node
I20260810 18:40:04.296309 3315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:04.297199 3315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:04.298398 3315 hybrid_clock.cc:648] HybridClock initialized: now 1786387204298336 us; error 52 us; skew 500 ppm
I20260810 18:40:04.298723 3315 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:04 dist-test-slave-5k54 krb5kdc[3052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:04.301972 3315 init.cc:377] Logged in from keytab as kudu/127.13.139.2@KRBTEST.COM (short username kudu)
I20260810 18:40:04.303318 3315 webserver.cc:460] Webserver started at http://127.13.139.2:38217/ using document root <none> and password file <none>
I20260810 18:40:04.304049 3315 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:04.304157 3315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:04.304409 3315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:04.307315 3315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "8f838bf4bedd44839b3b3ca33107f481"
format_stamp: "Formatted at 2026-08-10 18:40:04 on dist-test-slave-5k54"
server_key: "03d4473285b28feb354bb8e9cacfd79d"
server_key_iv: "82003249120935d825141fd430d7ac1c"
server_key_version: "encryptionkey@0"
I20260810 18:40:04.308192 3315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "8f838bf4bedd44839b3b3ca33107f481"
format_stamp: "Formatted at 2026-08-10 18:40:04 on dist-test-slave-5k54"
server_key: "03d4473285b28feb354bb8e9cacfd79d"
server_key_iv: "82003249120935d825141fd430d7ac1c"
server_key_version: "encryptionkey@0"
I20260810 18:40:04.313401 3315 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:40:04.316917 3331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:04.318215 3315 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:40:04.318423 3315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "8f838bf4bedd44839b3b3ca33107f481"
format_stamp: "Formatted at 2026-08-10 18:40:04 on dist-test-slave-5k54"
server_key: "03d4473285b28feb354bb8e9cacfd79d"
server_key_iv: "82003249120935d825141fd430d7ac1c"
server_key_version: "encryptionkey@0"
I20260810 18:40:04.318615 3315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:04.352542 3315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:04.357185 3315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:04.357482 3315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:04.358462 3315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:40:04.359946 3315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:40:04.360049 3315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:04.360199 3315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:40:04.360270 3315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:04.394418 3315 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:41019
I20260810 18:40:04.394510 3459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:41019 every 8 connection(s)
I20260810 18:40:04.395823 3315 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:40:04.403482 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 3315
I20260810 18:40:04.403707 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:40:04.404152 13868 external_mini_cluster.cc:1428] Setting key 29fe6d18af98a5c11f6192c3e0e5fdb7
Aug 10 18:40:04 dist-test-slave-5k54 krb5kdc[3052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.2@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:04.424347 3462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:04.398467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:43375 (local address 127.13.139.62:33495)
0810 18:40:04.398883 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:04.398887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:04.399944 (+ 1057us) server_negotiation.cc:407] Connection header received
0810 18:40:04.401722 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:04.401727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:04.401797 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:04.401906 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:04.403553 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.404439 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.406009 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.406504 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.406599 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:04.417796 (+ 11197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:04.417805 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:04.417813 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:04.417859 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:04.420875 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:04.421611 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:04.421619 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:04.421625 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:04.421807 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:04.422236 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:04.422243 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:04.422249 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:04.422656 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:04.422809 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:04.423618 (+ 809us) server_negotiation.cc:299] Negotiation successful
0810 18:40:04.423871 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":196,"threads_started":1}
I20260810 18:40:04.424997 3463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:04.399040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33495 (local address 127.13.139.2:43375)
0810 18:40:04.399770 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:04.399807 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:04.401454 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:04.402126 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:04.402134 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:04.402644 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:04.403348 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:04.403375 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.404591 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.404597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:04.405865 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:04.405877 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.406737 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.406747 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:04.407080 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:04.414421 (+ 7341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:04.414465 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:04.417524 (+ 3059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:04.421014 (+ 3490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:04.421021 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:04.421040 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:04.421460 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:04.421911 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:04.421915 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:04.421917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:04.422094 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:04.422806 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:04.422813 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:04.423146 (+ 333us) client_negotiation.cc:769] Sending connection context
0810 18:40:04.423477 (+ 331us) client_negotiation.cc:240] Negotiation successful
0810 18:40:04.423868 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":286,"threads_started":1}
I20260810 18:40:04.426417 3460 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33495
I20260810 18:40:04.426724 3460 heartbeater.cc:464] Registering TS with master...
I20260810 18:40:04.427464 3460 heartbeater.cc:511] Master 127.13.139.62:33495 requested a full tablet report, sending...
I20260810 18:40:04.429142 3102 ts_manager.cc:194] Registered new tserver with Master: 8f838bf4bedd44839b3b3ca33107f481 (127.13.139.2:41019)
I20260810 18:40:04.429960 3102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.2@KRBTEST.COM'} at 127.13.139.2:43375
WARNING: no policy specified for kudu/127.13.139.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
Entry for principal kudu/127.13.139.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab.
I20260810 18:40:04.475685 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33495
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:04.838240 3466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:04.838645 3466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:04.838852 3466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:04.848409 3466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:04.848569 3466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:04.848773 3466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:40:04.859843 3466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.3.keytab
--principal=kudu/127.13.139.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:33495
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:04.861259 3466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:04.862684 3466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 18:40:04.878343 3309 heartbeater.cc:503] Master 127.13.139.62:33495 was elected leader, sending a full tablet report...
W20260810 18:40:04.879078 3473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:04.879861 3475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:04.880595 3471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:04.881940 3466 server_base.cc:1034] running on GCE node
I20260810 18:40:04.882692 3466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:04.883839 3466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:04.885102 3466 hybrid_clock.cc:648] HybridClock initialized: now 1786387204885063 us; error 59 us; skew 500 ppm
I20260810 18:40:04.885465 3466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:04 dist-test-slave-5k54 krb5kdc[3052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:04.888959 3466 init.cc:377] Logged in from keytab as kudu/127.13.139.3@KRBTEST.COM (short username kudu)
I20260810 18:40:04.890633 3466 webserver.cc:460] Webserver started at http://127.13.139.3:36663/ using document root <none> and password file <none>
I20260810 18:40:04.891470 3466 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:04.891647 3466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:04.892010 3466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:04.895304 3466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "5a461e0bc6354a95a7d1dbe0d509cc17"
format_stamp: "Formatted at 2026-08-10 18:40:04 on dist-test-slave-5k54"
server_key: "a8dca567dd14fe97d9827e9385f3e25d"
server_key_iv: "fc89d02413ba9f6b64405b3c5d943821"
server_key_version: "encryptionkey@0"
I20260810 18:40:04.896220 3466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "5a461e0bc6354a95a7d1dbe0d509cc17"
format_stamp: "Formatted at 2026-08-10 18:40:04 on dist-test-slave-5k54"
server_key: "a8dca567dd14fe97d9827e9385f3e25d"
server_key_iv: "fc89d02413ba9f6b64405b3c5d943821"
server_key_version: "encryptionkey@0"
I20260810 18:40:04.901851 3466 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:40:04.905537 3483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:04.906980 3466 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:40:04.907153 3466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "5a461e0bc6354a95a7d1dbe0d509cc17"
format_stamp: "Formatted at 2026-08-10 18:40:04 on dist-test-slave-5k54"
server_key: "a8dca567dd14fe97d9827e9385f3e25d"
server_key_iv: "fc89d02413ba9f6b64405b3c5d943821"
server_key_version: "encryptionkey@0"
I20260810 18:40:04.907364 3466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:04.927788 3466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:04.931952 3466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:04.932257 3466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:04.933235 3466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:40:04.934584 3466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:40:04.934664 3466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:04.934789 3466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:40:04.934841 3466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:04.969408 3466 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:37359
I20260810 18:40:04.969463 3605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:37359 every 8 connection(s)
I20260810 18:40:04.970700 3466 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:40:04.977572 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 3466
I20260810 18:40:04.977768 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:40:04.978307 13868 external_mini_cluster.cc:1428] Setting key 82f68f4df73ed4bdf3a854b9afd9c877
Aug 10 18:40:04 dist-test-slave-5k54 krb5kdc[3052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387204, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.3@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:04.990690 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:04.973388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:48377 (local address 127.13.139.62:33495)
0810 18:40:04.973941 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:04.973947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:04.974868 (+ 921us) server_negotiation.cc:407] Connection header received
0810 18:40:04.976861 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:04.976866 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:04.976937 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:04.977036 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:04.979057 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.980051 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.981589 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.981984 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.982111 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:04.985589 (+ 3478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:04.985595 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:04.985598 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:04.985629 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:04.988125 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:04.988780 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:04.988784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:04.988786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:04.988896 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:04.989270 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:04.989273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:04.989275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:04.989526 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:04.989638 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:04.990249 (+ 611us) server_negotiation.cc:299] Negotiation successful
0810 18:40:04.990398 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":215,"threads_started":1}
I20260810 18:40:04.991806 3611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:04.973973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33495 (local address 127.13.139.3:48377)
0810 18:40:04.974707 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:04.974745 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:04.976521 (+ 1776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:04.977296 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:04.977310 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:04.978110 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:04.978870 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:04.978890 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.980213 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.980218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:04.981438 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:04.981449 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:04.982217 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:04.982225 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:04.982458 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:04.983135 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:04.983160 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:04.985390 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:04.988248 (+ 2858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:04.988254 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:04.988265 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:04.988682 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:04.988988 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:04.988991 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:04.988994 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:04.989174 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:04.989630 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:04.989635 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:04.989933 (+ 298us) client_negotiation.cc:769] Sending connection context
0810 18:40:04.990167 (+ 234us) client_negotiation.cc:240] Negotiation successful
0810 18:40:04.990548 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":292,"threads_started":1}
I20260810 18:40:04.993386 3606 heartbeater.cc:347] Connected to a master server at 127.13.139.62:33495
I20260810 18:40:04.993708 3606 heartbeater.cc:464] Registering TS with master...
I20260810 18:40:04.994408 3606 heartbeater.cc:511] Master 127.13.139.62:33495 requested a full tablet report, sending...
I20260810 18:40:04.995800 3102 ts_manager.cc:194] Registered new tserver with Master: 5a461e0bc6354a95a7d1dbe0d509cc17 (127.13.139.3:37359)
I20260810 18:40:04.996587 3102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.139.3@KRBTEST.COM'} at 127.13.139.3:48377
I20260810 18:40:05.005879 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:40:05.022672 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.010136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45176 (local address 127.13.139.62:33495)
0810 18:40:05.010402 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.010408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.010735 (+ 327us) server_negotiation.cc:407] Connection header received
0810 18:40:05.010875 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.010878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.010957 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.011032 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:05.012653 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.013378 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.014630 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.015107 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.015200 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.017644 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:05.017648 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:05.017651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:05.017677 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:05.020144 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.020830 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.020833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.020836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.020968 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.021351 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.021354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.021356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.021648 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:05.021842 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.022157 (+ 315us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.022385 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 18:40:05.026530 3102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:40:05.033711 3102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:40:05.057190 3626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.047843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:37359 (local address 127.0.0.1:58002)
0810 18:40:05.048440 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:05.048462 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:05.048589 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:05.049644 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:05.049649 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:05.049674 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:05.050337 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.050350 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.052449 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.052454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.054376 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.054390 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.056171 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.056179 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.056375 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.056427 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 18:40:05.056568 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 18:40:05.056759 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":99,"thread_start_us":305,"threads_started":1}
I20260810 18:40:05.057704 3627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.048207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58002 (local address 127.13.139.3:37359)
0810 18:40:05.049136 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.049144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.049173 (+ 29us) server_negotiation.cc:407] Connection header received
0810 18:40:05.049250 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.049256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.049428 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.049980 (+ 552us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:05.050532 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.052281 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.054576 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.055973 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.056112 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.056365 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.056861 (+ 496us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.057060 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":757,"thread_start_us":638,"threads_started":1}
I20260810 18:40:05.058357 3624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.045816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59730 (local address 127.13.139.1:45547)
0810 18:40:05.049008 (+ 3192us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.049015 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.049043 (+ 28us) server_negotiation.cc:407] Connection header received
0810 18:40:05.049143 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.049150 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.049411 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.049601 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:05.050497 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.051653 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.054382 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.055973 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.056622 (+ 649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.057171 (+ 549us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.058007 (+ 836us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.058127 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3024,"thread_start_us":2830,"threads_started":1}
I20260810 18:40:05.058476 3622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.045534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:45547 (local address 127.0.0.1:59730)
0810 18:40:05.046884 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:05.046947 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:05.047097 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:05.049609 (+ 2512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:05.049616 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:05.049643 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:05.050260 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.050277 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.051780 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.051787 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.054203 (+ 2416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.054218 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.057488 (+ 3270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.057494 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.057749 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.057863 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 18:40:05.057965 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 18:40:05.058098 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1126,"mutex_wait_us":185,"spinlock_wait_cycles":7040,"thread_start_us":990,"threads_started":1}
I20260810 18:40:05.060171 3623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.045760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:41019 (local address 127.0.0.1:43494)
0810 18:40:05.048165 (+ 2405us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:05.048183 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:05.048318 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:05.049877 (+ 1559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:05.049884 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:05.049907 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:05.050530 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.050543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.052452 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.052456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.055508 (+ 3052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.055521 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.057446 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.057455 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.057749 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.059586 (+ 1837us) client_negotiation.cc:769] Sending connection context
0810 18:40:05.059705 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 18:40:05.059826 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2236,"mutex_wait_us":133,"thread_start_us":2079,"threads_started":1}
I20260810 18:40:05.060266 3625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.046341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43494 (local address 127.13.139.2:41019)
0810 18:40:05.047680 (+ 1339us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.047691 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.048456 (+ 765us) server_negotiation.cc:407] Connection header received
0810 18:40:05.049185 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.049194 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.049429 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.049626 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:05.050705 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.052270 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.055658 (+ 3388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.056944 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.057079 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.057267 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.059757 (+ 2490us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.059933 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1175,"thread_start_us":1051,"threads_started":1}
I20260810 18:40:05.061825 3535 tablet_service.cc:1467] Processing CreateTablet for tablet 1079625e136f4348bb5402298956a567 (DEFAULT_TABLE table=test-table [id=80ef24d94a4549ac98eb5a7ad6a28563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:05.062124 3234 tablet_service.cc:1467] Processing CreateTablet for tablet 1079625e136f4348bb5402298956a567 (DEFAULT_TABLE table=test-table [id=80ef24d94a4549ac98eb5a7ad6a28563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:05.063467 3234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1079625e136f4348bb5402298956a567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:05.066200 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 1079625e136f4348bb5402298956a567 (DEFAULT_TABLE table=test-table [id=80ef24d94a4549ac98eb5a7ad6a28563]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:05.066984 3535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1079625e136f4348bb5402298956a567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:05.067557 3388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1079625e136f4348bb5402298956a567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:05.078243 3628 tablet_bootstrap.cc:492] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Bootstrap starting.
I20260810 18:40:05.081082 3631 tablet_bootstrap.cc:492] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Bootstrap starting.
I20260810 18:40:05.082535 3629 tablet_bootstrap.cc:492] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Bootstrap starting.
I20260810 18:40:05.083382 3628 tablet_bootstrap.cc:654] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:05.084455 3628 log.cc:824] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:05.084638 3631 tablet_bootstrap.cc:654] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:05.085902 3631 log.cc:824] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:05.086036 3629 tablet_bootstrap.cc:654] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:05.087298 3629 log.cc:824] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:05.088701 3631 tablet_bootstrap.cc:492] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: No bootstrap required, opened a new log
I20260810 18:40:05.088974 3631 ts_tablet_manager.cc:1397] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 18:40:05.089833 3629 tablet_bootstrap.cc:492] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: No bootstrap required, opened a new log
I20260810 18:40:05.090095 3629 ts_tablet_manager.cc:1397] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 18:40:05.093219 3628 tablet_bootstrap.cc:492] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: No bootstrap required, opened a new log
I20260810 18:40:05.093490 3628 ts_tablet_manager.cc:1397] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.000s
I20260810 18:40:05.097801 3629 raft_consensus.cc:348] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.098177 3629 raft_consensus.cc:374] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:05.098304 3629 raft_consensus.cc:729] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a461e0bc6354a95a7d1dbe0d509cc17, State: Initialized, Role: FOLLOWER
I20260810 18:40:05.098918 3629 consensus_queue.cc:260] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.099593 3631 raft_consensus.cc:348] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.100008 3606 heartbeater.cc:503] Master 127.13.139.62:33495 was elected leader, sending a full tablet report...
I20260810 18:40:05.100073 3631 raft_consensus.cc:374] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:05.100169 3631 raft_consensus.cc:729] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f838bf4bedd44839b3b3ca33107f481, State: Initialized, Role: FOLLOWER
I20260810 18:40:05.100721 3629 ts_tablet_manager.cc:1428] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260810 18:40:05.100839 3631 consensus_queue.cc:260] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.102020 3460 heartbeater.cc:503] Master 127.13.139.62:33495 was elected leader, sending a full tablet report...
I20260810 18:40:05.102705 3631 ts_tablet_manager.cc:1428] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260810 18:40:05.104014 3628 raft_consensus.cc:348] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.104472 3628 raft_consensus.cc:374] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:05.104606 3628 raft_consensus.cc:729] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af67b496bb446b969f3c4196053c84, State: Initialized, Role: FOLLOWER
I20260810 18:40:05.105350 3628 consensus_queue.cc:260] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.107390 3637 raft_consensus.cc:482] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:40:05.107725 3637 raft_consensus.cc:504] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.108211 3628 ts_tablet_manager.cc:1428] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260810 18:40:05.110132 3637 leader_election.cc:288] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f838bf4bedd44839b3b3ca33107f481 (127.13.139.2:41019), 5a461e0bc6354a95a7d1dbe0d509cc17 (127.13.139.3:37359)
I20260810 18:40:05.112193 3636 raft_consensus.cc:482] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:40:05.112515 3636 raft_consensus.cc:504] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.114502 3636 leader_election.cc:288] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23af67b496bb446b969f3c4196053c84 (127.13.139.1:45547), 5a461e0bc6354a95a7d1dbe0d509cc17 (127.13.139.3:37359)
I20260810 18:40:05.118870 3627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.110963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:36095 (local address 127.13.139.3:37359)
0810 18:40:05.111171 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.111177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.111199 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:40:05.111413 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.111448 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.111541 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.111634 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:05.112497 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.113673 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.116408 (+ 2735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.117654 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.117773 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.117865 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.118431 (+ 566us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.118572 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:40:05.119884 3638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.110428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:37359 (local address 127.13.139.1:36095)
0810 18:40:05.111110 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:05.111130 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:05.111261 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:05.111852 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:05.111858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:05.111890 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:05.112336 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.112349 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.113862 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.113867 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.116219 (+ 2352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.116234 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.118056 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.118062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.118233 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.118266 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 18:40:05.119305 (+ 1039us) client_negotiation.cc:240] Negotiation successful
0810 18:40:05.119463 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"mutex_wait_us":23,"thread_start_us":395,"threads_started":1}
I20260810 18:40:05.120067 3625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.110972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:48143 (local address 127.13.139.2:41019)
0810 18:40:05.111360 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.111366 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.112187 (+ 821us) server_negotiation.cc:407] Connection header received
0810 18:40:05.112511 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.112516 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.112598 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.112671 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:05.113446 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.114577 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.117517 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.118824 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.118960 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.119038 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.119653 (+ 615us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.119782 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254}
I20260810 18:40:05.120663 3639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.110471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:41019 (local address 127.13.139.1:48143)
0810 18:40:05.112083 (+ 1612us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:05.112106 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:05.112296 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:05.112870 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:05.112875 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:05.112899 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:05.113252 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.113263 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.114771 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.114777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.117311 (+ 2534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.117336 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.119236 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.119242 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.119460 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.119495 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 18:40:05.120313 (+ 818us) client_negotiation.cc:240] Negotiation successful
0810 18:40:05.120413 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1476,"mutex_wait_us":3,"thread_start_us":1222,"threads_started":1}
I20260810 18:40:05.124759 3556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1079625e136f4348bb5402298956a567" candidate_uuid: "23af67b496bb446b969f3c4196053c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" is_pre_election: true
I20260810 18:40:05.125386 3556 raft_consensus.cc:2454] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af67b496bb446b969f3c4196053c84 in term 0.
I20260810 18:40:05.125674 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1079625e136f4348bb5402298956a567" candidate_uuid: "23af67b496bb446b969f3c4196053c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f838bf4bedd44839b3b3ca33107f481" is_pre_election: true
I20260810 18:40:05.126204 3410 raft_consensus.cc:2454] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af67b496bb446b969f3c4196053c84 in term 0.
I20260810 18:40:05.126226 3184 leader_election.cc:302] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23af67b496bb446b969f3c4196053c84, 5a461e0bc6354a95a7d1dbe0d509cc17; no voters:
I20260810 18:40:05.126751 3637 raft_consensus.cc:2781] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:40:05.126993 3637 raft_consensus.cc:482] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:40:05.127167 3637 raft_consensus.cc:3037] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:05.130537 3637 raft_consensus.cc:504] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.131767 3624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.115166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:48405 (local address 127.13.139.1:45547)
0810 18:40:05.115515 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.115524 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.124244 (+ 8720us) server_negotiation.cc:407] Connection header received
0810 18:40:05.124476 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.124484 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.124579 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.124664 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:05.126821 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.127864 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.129639 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.130787 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.130968 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.131046 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.131380 (+ 334us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.131530 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260810 18:40:05.131731 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1079625e136f4348bb5402298956a567" candidate_uuid: "23af67b496bb446b969f3c4196053c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f838bf4bedd44839b3b3ca33107f481"
I20260810 18:40:05.131784 3556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1079625e136f4348bb5402298956a567" candidate_uuid: "23af67b496bb446b969f3c4196053c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17"
I20260810 18:40:05.131930 3410 raft_consensus.cc:3037] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:05.131991 3556 raft_consensus.cc:3037] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:05.132556 3627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.115684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:35267 (local address 127.13.139.3:37359)
0810 18:40:05.119267 (+ 3583us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.119273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.125073 (+ 5800us) server_negotiation.cc:407] Connection header received
0810 18:40:05.125307 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.125317 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.125388 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.125481 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:05.126321 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.127519 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.130057 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.131296 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.131466 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.131533 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.132089 (+ 556us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.132225 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3484,"thread_start_us":7916,"threads_started":1}
I20260810 18:40:05.132736 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.114623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:45547 (local address 127.13.139.2:48405)
0810 18:40:05.124124 (+ 9501us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:05.124139 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:05.124320 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:05.126190 (+ 1870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:05.126197 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:05.126227 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:05.126647 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.126658 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.127997 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.128002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.129486 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.129501 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.131010 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.131016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.131182 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.131220 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 18:40:05.132100 (+ 880us) client_negotiation.cc:240] Negotiation successful
0810 18:40:05.132254 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9389,"mutex_wait_us":21,"thread_start_us":9940,"threads_started":1}
I20260810 18:40:05.133261 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.114872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:37359 (local address 127.13.139.2:35267)
0810 18:40:05.124972 (+ 10100us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:05.124992 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:05.125168 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:05.125622 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:05.125627 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:05.125652 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:05.126122 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.126138 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.127652 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.127660 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.129898 (+ 2238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:05.129912 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.131685 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.131694 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:05.131874 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.131923 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 18:40:05.132704 (+ 781us) client_negotiation.cc:240] Negotiation successful
0810 18:40:05.132845 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9917,"mutex_wait_us":26,"thread_start_us":9294,"threads_started":1}
I20260810 18:40:05.134532 3556 raft_consensus.cc:2454] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af67b496bb446b969f3c4196053c84 in term 1.
I20260810 18:40:05.134692 3410 raft_consensus.cc:2454] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af67b496bb446b969f3c4196053c84 in term 1.
I20260810 18:40:05.135066 3637 leader_election.cc:288] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [CANDIDATE]: Term 1 election: Requested vote from peers 8f838bf4bedd44839b3b3ca33107f481 (127.13.139.2:41019), 5a461e0bc6354a95a7d1dbe0d509cc17 (127.13.139.3:37359)
I20260810 18:40:05.135110 3182 leader_election.cc:302] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23af67b496bb446b969f3c4196053c84, 8f838bf4bedd44839b3b3ca33107f481; no voters:
I20260810 18:40:05.135496 3637 raft_consensus.cc:2781] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:05.135921 3556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1079625e136f4348bb5402298956a567" candidate_uuid: "8f838bf4bedd44839b3b3ca33107f481" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" is_pre_election: true
I20260810 18:40:05.136117 3637 raft_consensus.cc:686] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 1 LEADER]: Becoming Leader. State: Replica: 23af67b496bb446b969f3c4196053c84, State: Running, Role: LEADER
I20260810 18:40:05.136312 3556 raft_consensus.cc:2379] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f838bf4bedd44839b3b3ca33107f481 in current term 1: Already voted for candidate 23af67b496bb446b969f3c4196053c84 in this term.
I20260810 18:40:05.135934 3256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1079625e136f4348bb5402298956a567" candidate_uuid: "8f838bf4bedd44839b3b3ca33107f481" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af67b496bb446b969f3c4196053c84" is_pre_election: true
I20260810 18:40:05.136763 3637 consensus_queue.cc:237] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } }
I20260810 18:40:05.137396 3334 leader_election.cc:302] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f838bf4bedd44839b3b3ca33107f481; no voters: 23af67b496bb446b969f3c4196053c84, 5a461e0bc6354a95a7d1dbe0d509cc17
I20260810 18:40:05.137825 3636 raft_consensus.cc:2726] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 18:40:05.141886 3101 catalog_manager.cc:5495] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23af67b496bb446b969f3c4196053c84 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "23af67b496bb446b969f3c4196053c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23af67b496bb446b969f3c4196053c84" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 45547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 } health_report { overall_health: UNKNOWN } } }
W20260810 18:40:05.147809 3461 tablet.cc:2369] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:05.157459 3624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.152101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59734 (local address 127.13.139.1:45547)
0810 18:40:05.152294 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.152301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.152421 (+ 120us) server_negotiation.cc:407] Connection header received
0810 18:40:05.152581 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.152584 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.152658 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.152775 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:05.153078 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.153955 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.155354 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.155834 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.155933 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.156367 (+ 434us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:05.156887 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:05.157001 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.157080 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.157144 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:40:05.165496 3556 raft_consensus.cc:1261] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 1 FOLLOWER]: Refusing update from remote peer 23af67b496bb446b969f3c4196053c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:05.165534 3410 raft_consensus.cc:1261] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 1 FOLLOWER]: Refusing update from remote peer 23af67b496bb446b969f3c4196053c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:05.166436 3643 consensus_queue.cc:1035] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a461e0bc6354a95a7d1dbe0d509cc17" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 37359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:05.166771 3637 consensus_queue.cc:1035] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f838bf4bedd44839b3b3ca33107f481" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 41019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:05.178267 3646 mvcc.cc:205] Tried to move back new op lower bound from 7317041992348016640 to 7317041992245288960. Current Snapshot: MvccSnapshot[applied={T|T < 7317041992348016640}]
I20260810 18:40:05.180308 3648 mvcc.cc:205] Tried to move back new op lower bound from 7317041992348016640 to 7317041992245288960. Current Snapshot: MvccSnapshot[applied={T|T < 7317041992348016640}]
I20260810 18:40:05.191998 3102 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:40:05.192273 3102 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:40:05.195784 3102 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b54694ee5de046e3879e7d9bbf8ca5a3: Sending DeleteTablet for 3 replicas of tablet 1079625e136f4348bb5402298956a567
I20260810 18:40:05.196928 3234 tablet_service.cc:1514] Processing DeleteTablet for tablet 1079625e136f4348bb5402298956a567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:05 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:59730
I20260810 18:40:05.196943 3388 tablet_service.cc:1514] Processing DeleteTablet for tablet 1079625e136f4348bb5402298956a567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:05 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:43494
I20260810 18:40:05.197650 3535 tablet_service.cc:1514] Processing DeleteTablet for tablet 1079625e136f4348bb5402298956a567 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:05 UTC) from {username='kudu', principal='kudu/127.13.139.62@KRBTEST.COM'} at 127.0.0.1:58002
I20260810 18:40:05.197849 3657 tablet_replica.cc:330] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: stopping tablet replica
I20260810 18:40:05.198249 3657 raft_consensus.cc:2229] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:40:05.198850 3657 raft_consensus.cc:2258] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:05.200791 3657 ts_tablet_manager.cc:1905] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:05.202327 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 3166
I20260810 18:40:05.208451 3657 ts_tablet_manager.cc:1918] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:40:05.208673 3657 log.cc:1196] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-0/wal/wals/1079625e136f4348bb5402298956a567
I20260810 18:40:05.209256 3657 ts_tablet_manager.cc:1939] T 1079625e136f4348bb5402298956a567 P 23af67b496bb446b969f3c4196053c84: Deleting consensus metadata
I20260810 18:40:05.211272 3085 catalog_manager.cc:4841] TS 23af67b496bb446b969f3c4196053c84 (127.13.139.1:45547): tablet 1079625e136f4348bb5402298956a567 (table test-table [id=80ef24d94a4549ac98eb5a7ad6a28563]) successfully deleted
I20260810 18:40:05.216638 3660 tablet_replica.cc:330] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: stopping tablet replica
I20260810 18:40:05.217134 3660 raft_consensus.cc:2229] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:40:05.217703 3660 raft_consensus.cc:2258] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:05.220239 3659 tablet_replica.cc:330] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: stopping tablet replica
I20260810 18:40:05.220784 3659 raft_consensus.cc:2229] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:40:05.221305 3659 raft_consensus.cc:2258] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:05.223708 3660 ts_tablet_manager.cc:1905] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 18:40:05 dist-test-slave-5k54 krb5kdc[3052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.1@KRBTEST.COM
I20260810 18:40:05.230907 3660 ts_tablet_manager.cc:1918] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:40:05.231112 3660 log.cc:1196] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/1079625e136f4348bb5402298956a567
I20260810 18:40:05.231791 3660 ts_tablet_manager.cc:1939] T 1079625e136f4348bb5402298956a567 P 5a461e0bc6354a95a7d1dbe0d509cc17: Deleting consensus metadata
I20260810 18:40:05.233692 3086 catalog_manager.cc:4841] TS 5a461e0bc6354a95a7d1dbe0d509cc17 (127.13.139.3:37359): tablet 1079625e136f4348bb5402298956a567 (table test-table [id=80ef24d94a4549ac98eb5a7ad6a28563]) successfully deleted
I20260810 18:40:05.235546 3659 ts_tablet_manager.cc:1905] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:05.236593 3624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.203393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59746 (local address 127.13.139.1:45547)
0810 18:40:05.203655 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.203661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.215960 (+ 12299us) server_negotiation.cc:407] Connection header received
0810 18:40:05.216160 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.216165 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.216258 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.216381 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:05.218323 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.219549 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.221538 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.222284 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.222415 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.228288 (+ 5873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:05.228303 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:05.228320 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:05.228360 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:05.232849 (+ 4489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.233832 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.233842 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.233846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.234027 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.234480 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.234485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.234488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.235047 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:05.235347 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.236028 (+ 681us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.236262 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260810 18:40:05.238332 3304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:05.242540 3659 ts_tablet_manager.cc:1918] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:40:05.242738 3659 log.cc:1196] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/1079625e136f4348bb5402298956a567
I20260810 18:40:05.243283 3659 ts_tablet_manager.cc:1939] T 1079625e136f4348bb5402298956a567 P 8f838bf4bedd44839b3b3ca33107f481: Deleting consensus metadata
I20260810 18:40:05.244822 3084 catalog_manager.cc:4841] TS 8f838bf4bedd44839b3b3ca33107f481 (127.13.139.2:41019): tablet 1079625e136f4348bb5402298956a567 (table test-table [id=80ef24d94a4549ac98eb5a7ad6a28563]) successfully deleted
I20260810 18:40:05.339275 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 3166
I20260810 18:40:05.361795 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 3315
Aug 10 18:40:05 dist-test-slave-5k54 krb5kdc[3052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.2@KRBTEST.COM
I20260810 18:40:05.377789 3625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.362640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43502 (local address 127.13.139.2:41019)
0810 18:40:05.362824 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.362830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.362852 (+ 22us) server_negotiation.cc:407] Connection header received
0810 18:40:05.362957 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.362961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.363024 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.363108 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:05.364484 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.365242 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.366450 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.366817 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.366909 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.371765 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:05.371781 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:05.371797 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:05.371843 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:05.374888 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.375739 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.375746 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.375748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.375904 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.376270 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.376288 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.376291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.376719 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:05.376981 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.377170 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.377384 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:40:05.378512 3455 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:05.473851 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 3315
I20260810 18:40:05.495136 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 3466
Aug 10 18:40:05 dist-test-slave-5k54 krb5kdc[3052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.3@KRBTEST.COM
I20260810 18:40:05.511049 3627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:05.495946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58008 (local address 127.13.139.3:37359)
0810 18:40:05.496134 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:05.496138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:05.496202 (+ 64us) server_negotiation.cc:407] Connection header received
0810 18:40:05.496349 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:05.496353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:05.496443 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:05.496531 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:05.497870 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.498553 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.499965 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:05.500368 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:05.500463 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:05.504978 (+ 4515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:05.504993 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:05.505009 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:05.505042 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:05.508065 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.508767 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.508778 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.508783 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.508994 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:05.509487 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:05.509494 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:05.509500 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:05.510045 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:05.510271 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:05.510528 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 18:40:05.510696 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:40:05.511813 3601 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:05.602054 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 3466
I20260810 18:40:05.622578 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 3067
I20260810 18:40:05.623782 3134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:05.735357 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 3067
2026-08-10T18:40:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4467 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T18:40:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:05Z Disabled control of system clock
I20260810 18:40:05.828838 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44665
--webserver_interface=127.13.139.62
--webserver_port=0
--builtin_ntp_servers=127.13.139.20:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:44665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 18:40:06.166575 3670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:06.166867 3670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:06.166952 3670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:06.174191 3670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:06.174302 3670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:06.174351 3670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:06.174410 3670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:06.174455 3670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:06.183502 3670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:44665
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:44665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:06.184726 3670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:06.186419 3670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:06.197758 3676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:06.197891 3678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:06.197850 3675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:06.198778 3670 server_base.cc:1034] running on GCE node
I20260810 18:40:06.199656 3670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:06.201061 3670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:06.202320 3670 hybrid_clock.cc:648] HybridClock initialized: now 1786387206202253 us; error 56 us; skew 500 ppm
I20260810 18:40:06.202718 3670 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:40:06.209044 3670 webserver.cc:460] Webserver started at http://127.13.139.62:36765/ using document root <none> and password file <none>
I20260810 18:40:06.209771 3670 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:06.209913 3670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:06.210247 3670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:06.213264 3670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "69820dc61260467abe43a249aeb33932"
format_stamp: "Formatted at 2026-08-10 18:40:06 on dist-test-slave-5k54"
server_key: "c9e442545bcabd218b7965a2fbb87613"
server_key_iv: "d99fb5f16677e096255ed68822d87f55"
server_key_version: "encryptionkey@0"
I20260810 18:40:06.214092 3670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "69820dc61260467abe43a249aeb33932"
format_stamp: "Formatted at 2026-08-10 18:40:06 on dist-test-slave-5k54"
server_key: "c9e442545bcabd218b7965a2fbb87613"
server_key_iv: "d99fb5f16677e096255ed68822d87f55"
server_key_version: "encryptionkey@0"
I20260810 18:40:06.219280 3670 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 18:40:06.222811 3684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:06.224282 3670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:40:06.224485 3670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "69820dc61260467abe43a249aeb33932"
format_stamp: "Formatted at 2026-08-10 18:40:06 on dist-test-slave-5k54"
server_key: "c9e442545bcabd218b7965a2fbb87613"
server_key_iv: "d99fb5f16677e096255ed68822d87f55"
server_key_version: "encryptionkey@0"
I20260810 18:40:06.224704 3670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:06.258442 3670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:06.259325 3670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:06.259661 3670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:06.278637 3670 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:44665
I20260810 18:40:06.278677 3740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:44665 every 8 connection(s)
I20260810 18:40:06.280014 3670 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:06.283800 3741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:06.287848 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 3670
I20260810 18:40:06.288028 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:06.288496 13868 external_mini_cluster.cc:1428] Setting key e3ce687e71e0970ba1534f88d1925c39
I20260810 18:40:06.295014 3741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932: Bootstrap starting.
I20260810 18:40:06.298755 3741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:06.300117 3741 log.cc:824] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:06.303012 3744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:06.290327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38804 (local address 127.13.139.62:44665)
0810 18:40:06.291316 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:06.291337 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:06.291381 (+ 44us) server_negotiation.cc:407] Connection header received
0810 18:40:06.293524 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:06.293545 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:06.293991 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:06.294290 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:06.294969 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:06.296350 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:06.298286 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:06.299050 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:06.299197 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:06.300480 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:06.300488 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:06.300500 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:06.301305 (+ 805us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:06.301408 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:06.301438 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:06.301557 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:06.301792 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 18:40:06.302106 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":376,"threads_started":1}
I20260810 18:40:06.303366 3741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932: No bootstrap required, opened a new log
I20260810 18:40:06.311230 3741 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69820dc61260467abe43a249aeb33932" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44665 } }
I20260810 18:40:06.311669 3741 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:06.311802 3741 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69820dc61260467abe43a249aeb33932, State: Initialized, Role: FOLLOWER
I20260810 18:40:06.312426 3741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69820dc61260467abe43a249aeb33932" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44665 } }
I20260810 18:40:06.312682 3741 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:06.312834 3741 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:06.313014 3741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:06.315169 3741 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69820dc61260467abe43a249aeb33932" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44665 } }
I20260810 18:40:06.315809 3741 leader_election.cc:302] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69820dc61260467abe43a249aeb33932; no voters:
I20260810 18:40:06.316478 3741 leader_election.cc:288] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:06.316603 3746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:06.317366 3746 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [term 1 LEADER]: Becoming Leader. State: Replica: 69820dc61260467abe43a249aeb33932, State: Running, Role: LEADER
I20260810 18:40:06.317889 3746 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69820dc61260467abe43a249aeb33932" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44665 } }
I20260810 18:40:06.318648 3741 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:06.320672 3748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69820dc61260467abe43a249aeb33932. Latest consensus state: current_term: 1 leader_uuid: "69820dc61260467abe43a249aeb33932" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69820dc61260467abe43a249aeb33932" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44665 } } }
I20260810 18:40:06.321184 3748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:06.320744 3747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69820dc61260467abe43a249aeb33932" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69820dc61260467abe43a249aeb33932" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 44665 } } }
I20260810 18:40:06.322134 3747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:06.323760 3753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:06.329074 3753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:06.338308 3753 catalog_manager.cc:1347] Generated new cluster ID: 7c15dd68d02a4ac2bd6b425be6677e19
I20260810 18:40:06.338443 3753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:06.362152 3753 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:06.363551 3753 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:06.373135 3753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932: Generated new TSK 0
I20260810 18:40:06.373951 3753 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:06.379519 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.1:0
--local_ip_for_outbound_sockets=127.13.139.1
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44665
--builtin_ntp_servers=127.13.139.20:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 18:40:06.758625 3766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:06.758899 3766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:06.759074 3766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:06.766592 3766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:06.766686 3766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:06.766889 3766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.1
I20260810 18:40:06.776113 3766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.139.1
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.1
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:06.777460 3766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:06.779245 3766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:06.792397 3773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:06.792634 3771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:06.792409 3775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:06.793215 3766 server_base.cc:1034] running on GCE node
I20260810 18:40:06.793892 3766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:06.794824 3766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:06.796032 3766 hybrid_clock.cc:648] HybridClock initialized: now 1786387206795995 us; error 31 us; skew 500 ppm
I20260810 18:40:06.796363 3766 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:40:06.798573 3766 webserver.cc:460] Webserver started at http://127.13.139.1:42013/ using document root <none> and password file <none>
I20260810 18:40:06.799281 3766 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:06.799402 3766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:06.799789 3766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:06.802663 3766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data/instance:
uuid: "c66955f278994fcd8b983a6f70f95711"
format_stamp: "Formatted at 2026-08-10 18:40:06 on dist-test-slave-5k54"
server_key: "75501a19eae0ef85a71304160d9408ba"
server_key_iv: "e461e2617d80aac2b60baa8b679ed79f"
server_key_version: "encryptionkey@0"
I20260810 18:40:06.803539 3766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance:
uuid: "c66955f278994fcd8b983a6f70f95711"
format_stamp: "Formatted at 2026-08-10 18:40:06 on dist-test-slave-5k54"
server_key: "75501a19eae0ef85a71304160d9408ba"
server_key_iv: "e461e2617d80aac2b60baa8b679ed79f"
server_key_version: "encryptionkey@0"
I20260810 18:40:06.808691 3766 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 18:40:06.812146 3783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:06.813439 3766 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:06.813611 3766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/wal
uuid: "c66955f278994fcd8b983a6f70f95711"
format_stamp: "Formatted at 2026-08-10 18:40:06 on dist-test-slave-5k54"
server_key: "75501a19eae0ef85a71304160d9408ba"
server_key_iv: "e461e2617d80aac2b60baa8b679ed79f"
server_key_version: "encryptionkey@0"
I20260810 18:40:06.813833 3766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:06.834134 3766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:06.834960 3766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:06.835268 3766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:06.836395 3766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:40:06.837877 3766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:40:06.838008 3766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:06.838143 3766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:40:06.838231 3766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:06.874509 3766 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.1:36157
I20260810 18:40:06.874593 3908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.1:36157 every 8 connection(s)
I20260810 18:40:06.876317 3766 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/data/info.pb
I20260810 18:40:06.877372 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 3766
I20260810 18:40:06.877578 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-0/wal/instance
I20260810 18:40:06.878152 13868 external_mini_cluster.cc:1428] Setting key 5f7a3033c0cac5af8d392e3c27be2290
I20260810 18:40:06.881250 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.2:0
--local_ip_for_outbound_sockets=127.13.139.2
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44665
--builtin_ntp_servers=127.13.139.20:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 18:40:06.890311 3912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:06.879264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:45805 (local address 127.13.139.62:44665)
0810 18:40:06.879750 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:06.879756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:06.881327 (+ 1571us) server_negotiation.cc:407] Connection header received
0810 18:40:06.883178 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:06.883186 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:06.883277 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:06.883398 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:06.884489 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:06.885615 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:06.887137 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:06.887903 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:06.888044 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:06.889362 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:06.889370 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:06.889378 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:06.889412 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:06.889464 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:06.889484 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:06.889576 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:06.889780 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 18:40:06.889893 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":259,"threads_started":1}
I20260810 18:40:06.891116 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:06.879985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44665 (local address 127.13.139.1:45805)
0810 18:40:06.881143 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:06.881189 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:06.882916 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:06.883649 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:06.883657 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:06.883743 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:06.884311 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:06.884328 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:06.885757 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:06.885761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:06.886992 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:06.887005 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:06.888117 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:06.888122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:06.888316 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:06.889041 (+ 725us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:40:06.889044 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:06.889082 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:40:06.889161 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:06.889580 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:06.889589 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:06.889595 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 18:40:06.889733 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 18:40:06.890028 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":404,"threads_started":1}
I20260810 18:40:06.892694 3910 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44665
I20260810 18:40:06.893004 3910 heartbeater.cc:464] Registering TS with master...
I20260810 18:40:06.893726 3910 heartbeater.cc:511] Master 127.13.139.62:44665 requested a full tablet report, sending...
I20260810 18:40:06.895948 3703 ts_manager.cc:194] Registered new tserver with Master: c66955f278994fcd8b983a6f70f95711 (127.13.139.1:36157)
I20260810 18:40:06.897370 3703 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.1:45805
W20260810 18:40:07.215816 3914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:07.216143 3914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:07.216303 3914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:07.223984 3914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:07.224108 3914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:07.224287 3914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.2
I20260810 18:40:07.233340 3914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.139.2
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.2
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:07.234629 3914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:07.236413 3914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:07.250204 3919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:07.250291 3921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:07.250191 3923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:07.251384 3914 server_base.cc:1034] running on GCE node
I20260810 18:40:07.252032 3914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:07.252949 3914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:07.254143 3914 hybrid_clock.cc:648] HybridClock initialized: now 1786387207254086 us; error 57 us; skew 500 ppm
I20260810 18:40:07.254451 3914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:40:07.256760 3914 webserver.cc:460] Webserver started at http://127.13.139.2:37471/ using document root <none> and password file <none>
I20260810 18:40:07.257437 3914 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:07.257550 3914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:07.257865 3914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:07.260696 3914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data/instance:
uuid: "61fa5cda55e542219bf528f4919fe9fc"
format_stamp: "Formatted at 2026-08-10 18:40:07 on dist-test-slave-5k54"
server_key: "140fb62ae502c58dadc7eb6920a4a04d"
server_key_iv: "b63498bcc112ce3994366895f3e498d3"
server_key_version: "encryptionkey@0"
I20260810 18:40:07.261461 3914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance:
uuid: "61fa5cda55e542219bf528f4919fe9fc"
format_stamp: "Formatted at 2026-08-10 18:40:07 on dist-test-slave-5k54"
server_key: "140fb62ae502c58dadc7eb6920a4a04d"
server_key_iv: "b63498bcc112ce3994366895f3e498d3"
server_key_version: "encryptionkey@0"
I20260810 18:40:07.266360 3914 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 18:40:07.269657 3929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:07.270849 3914 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 18:40:07.271016 3914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal
uuid: "61fa5cda55e542219bf528f4919fe9fc"
format_stamp: "Formatted at 2026-08-10 18:40:07 on dist-test-slave-5k54"
server_key: "140fb62ae502c58dadc7eb6920a4a04d"
server_key_iv: "b63498bcc112ce3994366895f3e498d3"
server_key_version: "encryptionkey@0"
I20260810 18:40:07.271222 3914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:07.297178 3914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:07.297977 3914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:07.298281 3914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:07.299311 3914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:40:07.300804 3914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:40:07.300925 3914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:07.301054 3914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:40:07.301144 3914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:07.334677 3914 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.2:37643
I20260810 18:40:07.334767 4052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.2:37643 every 8 connection(s)
I20260810 18:40:07.335995 3914 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/data/info.pb
I20260810 18:40:07.344209 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 3914
I20260810 18:40:07.344398 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal/instance
I20260810 18:40:07.344854 13868 external_mini_cluster.cc:1428] Setting key 3e259c00cf28efa787edc1430a8e8a67
I20260810 18:40:07.348045 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.139.3:0
--local_ip_for_outbound_sockets=127.13.139.3
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44665
--builtin_ntp_servers=127.13.139.20:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 18:40:07.348269 3912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.338544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.2:36777 (local address 127.13.139.62:44665)
0810 18:40:07.338728 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:07.338732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:07.340069 (+ 1337us) server_negotiation.cc:407] Connection header received
0810 18:40:07.341732 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:07.341736 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:07.341807 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:07.341895 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:07.342851 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.343643 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.345287 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.345845 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.345971 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.347439 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:07.347446 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:07.347451 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:07.347474 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:07.347513 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:07.347529 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:07.347623 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:07.347838 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 18:40:07.347932 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:40:07.349104 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.339002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44665 (local address 127.13.139.2:36777)
0810 18:40:07.339907 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:07.339950 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:07.341499 (+ 1549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:07.342090 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:07.342097 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:07.342183 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:07.342712 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.342727 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.343768 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.343772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.345139 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.345151 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.346079 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.346086 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.346346 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.347110 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:40:07.347112 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:07.347150 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:40:07.347222 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:07.347621 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:07.347629 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:07.347634 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 18:40:07.347786 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 18:40:07.348050 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":260,"threads_started":1}
I20260810 18:40:07.350451 4053 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44665
I20260810 18:40:07.350754 4053 heartbeater.cc:464] Registering TS with master...
I20260810 18:40:07.351610 4053 heartbeater.cc:511] Master 127.13.139.62:44665 requested a full tablet report, sending...
I20260810 18:40:07.353120 3703 ts_manager.cc:194] Registered new tserver with Master: 61fa5cda55e542219bf528f4919fe9fc (127.13.139.2:37643)
I20260810 18:40:07.353899 3703 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.2:36777
W20260810 18:40:07.681391 4056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:07.681694 4056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:07.681893 4056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:07.688803 4056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:07.688941 4056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:07.689126 4056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.139.3
I20260810 18:40:07.697763 4056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.139.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.139.3
--webserver_port=0
--tserver_master_addrs=127.13.139.62:44665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.139.3
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:07.699043 4056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:07.700798 4056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:07.713967 4065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:07.713943 4061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:07.714213 4062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:07.714686 4056 server_base.cc:1034] running on GCE node
I20260810 18:40:07.715296 4056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:07.716245 4056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:07.717466 4056 hybrid_clock.cc:648] HybridClock initialized: now 1786387207717405 us; error 51 us; skew 500 ppm
I20260810 18:40:07.717788 4056 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 18:40:07.720194 4056 webserver.cc:460] Webserver started at http://127.13.139.3:42925/ using document root <none> and password file <none>
I20260810 18:40:07.720867 4056 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:07.721006 4056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:07.721314 4056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:07.724269 4056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data/instance:
uuid: "2e1043e727e745fba7d78b529596ab06"
format_stamp: "Formatted at 2026-08-10 18:40:07 on dist-test-slave-5k54"
server_key: "e2ee0ba790533d79d3eaa892bdd4b7dd"
server_key_iv: "e2d5299f5ab17c44b51528b764c2949f"
server_key_version: "encryptionkey@0"
I20260810 18:40:07.725075 4056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance:
uuid: "2e1043e727e745fba7d78b529596ab06"
format_stamp: "Formatted at 2026-08-10 18:40:07 on dist-test-slave-5k54"
server_key: "e2ee0ba790533d79d3eaa892bdd4b7dd"
server_key_iv: "e2d5299f5ab17c44b51528b764c2949f"
server_key_version: "encryptionkey@0"
I20260810 18:40:07.730268 4056 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:40:07.733771 4071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:07.735059 4056 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260810 18:40:07.735239 4056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal
uuid: "2e1043e727e745fba7d78b529596ab06"
format_stamp: "Formatted at 2026-08-10 18:40:07 on dist-test-slave-5k54"
server_key: "e2ee0ba790533d79d3eaa892bdd4b7dd"
server_key_iv: "e2d5299f5ab17c44b51528b764c2949f"
server_key_version: "encryptionkey@0"
I20260810 18:40:07.735476 4056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:07.765051 4056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:07.765956 4056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:07.766270 4056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:07.767292 4056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 18:40:07.768813 4056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 18:40:07.768946 4056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:07.769088 4056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 18:40:07.769177 4056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:07.802829 4056 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.3:41657
I20260810 18:40:07.802925 4198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.3:41657 every 8 connection(s)
I20260810 18:40:07.804286 4056 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/data/info.pb
I20260810 18:40:07.809996 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 4056
I20260810 18:40:07.810285 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal/instance
I20260810 18:40:07.810814 13868 external_mini_cluster.cc:1428] Setting key c8c4218dba791753f9c082b897fe9df7
I20260810 18:40:07.817204 3912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.806908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.3:46725 (local address 127.13.139.62:44665)
0810 18:40:07.807143 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:07.807150 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:07.808579 (+ 1429us) server_negotiation.cc:407] Connection header received
0810 18:40:07.810368 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:07.810374 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:07.810477 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:07.810590 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:07.812020 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.813036 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.814766 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.815162 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.815259 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.816528 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:07.816532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:07.816536 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:07.816553 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:07.816584 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:07.816596 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:07.816664 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:07.816876 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 18:40:07.816964 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 18:40:07.818241 4201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.807528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:44665 (local address 127.13.139.3:46725)
0810 18:40:07.808412 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:07.808449 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:07.810052 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:07.810861 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:07.810869 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:07.811005 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:07.811811 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.811839 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.813187 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.813193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.814636 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.814648 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.815340 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.815345 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.815613 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.816244 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 18:40:07.816247 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:07.816284 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 18:40:07.816358 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:07.816679 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:07.816686 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:07.816691 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 18:40:07.816832 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 18:40:07.817166 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":276,"threads_started":1}
I20260810 18:40:07.819682 4199 heartbeater.cc:347] Connected to a master server at 127.13.139.62:44665
I20260810 18:40:07.819989 4199 heartbeater.cc:464] Registering TS with master...
I20260810 18:40:07.820706 4199 heartbeater.cc:511] Master 127.13.139.62:44665 requested a full tablet report, sending...
I20260810 18:40:07.822073 3703 ts_manager.cc:194] Registered new tserver with Master: 2e1043e727e745fba7d78b529596ab06 (127.13.139.3:41657)
I20260810 18:40:07.822814 3703 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.139.3:46725
I20260810 18:40:07.825984 13868 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 18:40:07.835839 3912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.830236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38806 (local address 127.13.139.62:44665)
0810 18:40:07.830434 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:07.830439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:07.830957 (+ 518us) server_negotiation.cc:407] Connection header received
0810 18:40:07.831085 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:07.831089 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:07.831160 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:07.831241 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:07.831836 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.832529 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.833782 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.834181 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.834270 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.835227 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:07.835231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:07.835234 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:07.835250 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:07.835280 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:07.835291 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:07.835356 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:07.835543 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 18:40:07.835615 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 18:40:07.839604 3703 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 18:40:07.846549 3703 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 18:40:07.869541 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.858348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35594)
0810 18:40:07.859564 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:07.859608 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:07.859797 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:07.861445 (+ 1648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:07.861453 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:07.861486 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:07.861933 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.861949 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.864150 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.864157 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.866583 (+ 2426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.866594 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.868509 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.868515 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.868761 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.868826 (+ 65us) client_negotiation.cc:769] Sending connection context
0810 18:40:07.868938 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 18:40:07.869130 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"mutex_wait_us":1,"thread_start_us":2303,"threads_started":1}
I20260810 18:40:07.870954 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.858439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.13.139.1:36157)
0810 18:40:07.860781 (+ 2342us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:07.860791 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:07.860819 (+ 28us) server_negotiation.cc:407] Connection header received
0810 18:40:07.860930 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:07.860938 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:07.861190 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:07.862162 (+ 972us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:07.862391 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.863977 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.866831 (+ 2854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.868293 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.870066 (+ 1773us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.870320 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:07.870392 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 18:40:07.870571 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2179,"thread_start_us":2041,"threads_started":1}
I20260810 18:40:07.873232 4217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.859343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.13.139.3:41657)
0810 18:40:07.860502 (+ 1159us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:07.860521 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:07.862083 (+ 1562us) server_negotiation.cc:407] Connection header received
0810 18:40:07.862367 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:07.862375 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:07.862609 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:07.862767 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:07.863690 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.866310 (+ 2620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.870527 (+ 4217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.871735 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.871884 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.872155 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:07.872696 (+ 541us) server_negotiation.cc:299] Negotiation successful
0810 18:40:07.872860 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":977,"thread_start_us":838,"threads_started":1}
I20260810 18:40:07.874022 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.858722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:41657 (local address 127.0.0.1:51120)
0810 18:40:07.860940 (+ 2218us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:07.860961 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:07.862185 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:07.863068 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:07.863073 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:07.863097 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:07.863500 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.863513 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.866515 (+ 3002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.866525 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.870305 (+ 3780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.870323 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.872285 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.872291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.872479 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.872513 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 18:40:07.873421 (+ 908us) client_negotiation.cc:240] Negotiation successful
0810 18:40:07.873660 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2069,"mutex_wait_us":1713,"thread_start_us":935,"threads_started":1}
I20260810 18:40:07.875249 3841 tablet_service.cc:1467] Processing CreateTablet for tablet 312b04c8001a4c4a85368d72fbbf75fa (DEFAULT_TABLE table=test-table [id=06df4f5296f34ac3aa066ad834ae2f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:07.876775 3841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 312b04c8001a4c4a85368d72fbbf75fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:07.879105 4125 tablet_service.cc:1467] Processing CreateTablet for tablet 312b04c8001a4c4a85368d72fbbf75fa (DEFAULT_TABLE table=test-table [id=06df4f5296f34ac3aa066ad834ae2f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:07.879794 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.861042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:37643 (local address 127.0.0.1:41624)
0810 18:40:07.869777 (+ 8735us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:07.869798 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:07.869895 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:07.870508 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:07.870513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:07.870537 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:07.870695 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.870705 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.872821 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.872828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.874705 (+ 1877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:07.874719 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.878963 (+ 4244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.878969 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:07.879163 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.879207 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 18:40:07.879282 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 18:40:07.879464 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8649,"mutex_wait_us":1,"thread_start_us":8930,"threads_started":1}
I20260810 18:40:07.880616 4125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 312b04c8001a4c4a85368d72fbbf75fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:07.881721 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:07.861321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41624 (local address 127.13.139.2:37643)
0810 18:40:07.869916 (+ 8595us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:07.869925 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:07.869951 (+ 26us) server_negotiation.cc:407] Connection header received
0810 18:40:07.870042 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:07.870048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:07.870262 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:07.870861 (+ 599us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:07.871110 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.872640 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.875134 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:07.878768 (+ 3634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:07.880862 (+ 2094us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:07.881105 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:07.881170 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 18:40:07.881341 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8440,"thread_start_us":8304,"threads_started":1}
I20260810 18:40:07.885346 3983 tablet_service.cc:1467] Processing CreateTablet for tablet 312b04c8001a4c4a85368d72fbbf75fa (DEFAULT_TABLE table=test-table [id=06df4f5296f34ac3aa066ad834ae2f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 18:40:07.886677 3983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 312b04c8001a4c4a85368d72fbbf75fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:07.890005 4222 tablet_bootstrap.cc:492] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: Bootstrap starting.
I20260810 18:40:07.893137 4222 tablet_bootstrap.cc:654] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:07.894138 4222 log.cc:824] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:07.897209 4224 tablet_bootstrap.cc:492] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Bootstrap starting.
I20260810 18:40:07.898164 4222 tablet_bootstrap.cc:492] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: No bootstrap required, opened a new log
I20260810 18:40:07.898444 4222 ts_tablet_manager.cc:1397] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260810 18:40:07.900640 4225 tablet_bootstrap.cc:492] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Bootstrap starting.
I20260810 18:40:07.900755 4224 tablet_bootstrap.cc:654] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:07.901013 3910 heartbeater.cc:503] Master 127.13.139.62:44665 was elected leader, sending a full tablet report...
I20260810 18:40:07.901969 4224 log.cc:824] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:07.904955 4225 tablet_bootstrap.cc:654] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:07.906250 4225 log.cc:824] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:07.909031 4224 tablet_bootstrap.cc:492] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: No bootstrap required, opened a new log
I20260810 18:40:07.909247 4225 tablet_bootstrap.cc:492] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: No bootstrap required, opened a new log
I20260810 18:40:07.909296 4224 ts_tablet_manager.cc:1397] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260810 18:40:07.909492 4225 ts_tablet_manager.cc:1397] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260810 18:40:07.909848 4222 raft_consensus.cc:348] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:07.910292 4222 raft_consensus.cc:374] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:07.910418 4222 raft_consensus.cc:729] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66955f278994fcd8b983a6f70f95711, State: Initialized, Role: FOLLOWER
I20260810 18:40:07.911062 4222 consensus_queue.cc:260] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:07.912758 4222 ts_tablet_manager.cc:1428] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260810 18:40:07.918131 4224 raft_consensus.cc:348] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:07.918501 4224 raft_consensus.cc:374] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:07.918283 4225 raft_consensus.cc:348] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:07.918612 4224 raft_consensus.cc:729] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e1043e727e745fba7d78b529596ab06, State: Initialized, Role: FOLLOWER
I20260810 18:40:07.918720 4225 raft_consensus.cc:374] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:07.918834 4225 raft_consensus.cc:729] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fa5cda55e542219bf528f4919fe9fc, State: Initialized, Role: FOLLOWER
I20260810 18:40:07.919229 4224 consensus_queue.cc:260] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:07.919394 4225 consensus_queue.cc:260] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:07.920527 4199 heartbeater.cc:503] Master 127.13.139.62:44665 was elected leader, sending a full tablet report...
I20260810 18:40:07.921123 4224 ts_tablet_manager.cc:1428] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260810 18:40:07.921870 4053 heartbeater.cc:503] Master 127.13.139.62:44665 was elected leader, sending a full tablet report...
I20260810 18:40:07.922426 4225 ts_tablet_manager.cc:1428] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260810 18:40:08.023810 4228 raft_consensus.cc:482] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 18:40:08.024197 4228 raft_consensus.cc:504] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:08.026049 4228 leader_election.cc:288] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61fa5cda55e542219bf528f4919fe9fc (127.13.139.2:37643), 2e1043e727e745fba7d78b529596ab06 (127.13.139.3:41657)
I20260810 18:40:08.033180 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.026774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:37503 (local address 127.13.139.2:37643)
0810 18:40:08.027073 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:08.027081 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:08.027584 (+ 503us) server_negotiation.cc:407] Connection header received
0810 18:40:08.027881 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:08.027886 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:08.027999 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:08.028117 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:08.028787 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.029586 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.031496 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.032229 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.032421 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.032498 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:08.032784 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 18:40:08.032906 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260810 18:40:08.033277 4233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.026331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.2:37643 (local address 127.13.139.1:37503)
0810 18:40:08.027407 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.027475 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:08.027675 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:08.028130 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:08.028135 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:08.028161 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:08.028611 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:08.028622 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.029719 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.029727 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:08.031259 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:08.031282 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.032421 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.032427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:08.032606 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.032630 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 18:40:08.032747 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 18:40:08.032871 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"thread_start_us":1126,"threads_started":1}
I20260810 18:40:08.033293 4217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.026747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.139.1:51651 (local address 127.13.139.3:41657)
0810 18:40:08.027281 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:08.027289 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:08.027903 (+ 614us) server_negotiation.cc:407] Connection header received
0810 18:40:08.028100 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:08.028104 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:08.028161 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:08.028259 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 18:40:08.029008 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.029754 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.031566 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.032352 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.032534 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.032603 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:08.032878 (+ 275us) server_negotiation.cc:299] Negotiation successful
0810 18:40:08.033037 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358}
I20260810 18:40:08.033440 4232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.026344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.3:41657 (local address 127.13.139.1:51651)
0810 18:40:08.027757 (+ 1413us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.027772 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:08.027932 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:08.028301 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:08.028310 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:08.028345 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 18:40:08.028826 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:08.028835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.029893 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.029902 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:08.031325 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:08.031338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.032554 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.032560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:08.032724 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.032746 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 18:40:08.032850 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 18:40:08.032974 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1302,"mutex_wait_us":6,"thread_start_us":650,"threads_started":1}
I20260810 18:40:08.034479 4147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312b04c8001a4c4a85368d72fbbf75fa" candidate_uuid: "c66955f278994fcd8b983a6f70f95711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1043e727e745fba7d78b529596ab06" is_pre_election: true
I20260810 18:40:08.034627 4006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312b04c8001a4c4a85368d72fbbf75fa" candidate_uuid: "c66955f278994fcd8b983a6f70f95711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fa5cda55e542219bf528f4919fe9fc" is_pre_election: true
I20260810 18:40:08.035014 4147 raft_consensus.cc:2454] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c66955f278994fcd8b983a6f70f95711 in term 0.
I20260810 18:40:08.035125 4006 raft_consensus.cc:2454] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c66955f278994fcd8b983a6f70f95711 in term 0.
I20260810 18:40:08.035727 3787 leader_election.cc:302] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e1043e727e745fba7d78b529596ab06, c66955f278994fcd8b983a6f70f95711; no voters:
I20260810 18:40:08.036151 4228 raft_consensus.cc:2781] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 18:40:08.036303 4228 raft_consensus.cc:482] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 18:40:08.036428 4228 raft_consensus.cc:3037] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:08.038568 4228 raft_consensus.cc:504] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:08.039266 4228 leader_election.cc:288] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [CANDIDATE]: Term 1 election: Requested vote from peers 61fa5cda55e542219bf528f4919fe9fc (127.13.139.2:37643), 2e1043e727e745fba7d78b529596ab06 (127.13.139.3:41657)
I20260810 18:40:08.039661 4006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312b04c8001a4c4a85368d72fbbf75fa" candidate_uuid: "c66955f278994fcd8b983a6f70f95711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fa5cda55e542219bf528f4919fe9fc"
I20260810 18:40:08.039865 4006 raft_consensus.cc:3037] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:08.039860 4147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312b04c8001a4c4a85368d72fbbf75fa" candidate_uuid: "c66955f278994fcd8b983a6f70f95711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e1043e727e745fba7d78b529596ab06"
I20260810 18:40:08.040062 4147 raft_consensus.cc:3037] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:08.042173 4006 raft_consensus.cc:2454] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66955f278994fcd8b983a6f70f95711 in term 1.
I20260810 18:40:08.042338 4147 raft_consensus.cc:2454] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66955f278994fcd8b983a6f70f95711 in term 1.
I20260810 18:40:08.042587 3786 leader_election.cc:302] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fa5cda55e542219bf528f4919fe9fc, c66955f278994fcd8b983a6f70f95711; no voters:
I20260810 18:40:08.042882 4228 raft_consensus.cc:2781] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:08.043305 4228 raft_consensus.cc:686] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 1 LEADER]: Becoming Leader. State: Replica: c66955f278994fcd8b983a6f70f95711, State: Running, Role: LEADER
I20260810 18:40:08.043895 4228 consensus_queue.cc:237] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } }
I20260810 18:40:08.048774 3702 catalog_manager.cc:5495] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 reported cstate change: term changed from 0 to 1, leader changed from <none> to c66955f278994fcd8b983a6f70f95711 (127.13.139.1). New cstate: current_term: 1 leader_uuid: "c66955f278994fcd8b983a6f70f95711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66955f278994fcd8b983a6f70f95711" member_type: VOTER last_known_addr { host: "127.13.139.1" port: 36157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 } health_report { overall_health: UNKNOWN } } }
W20260810 18:40:08.056000 4200 tablet.cc:2369] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 18:40:08.088094 4054 tablet.cc:2369] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:08.106145 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.101085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35600 (local address 127.13.139.1:36157)
0810 18:40:08.101278 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:08.101283 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:08.101300 (+ 17us) server_negotiation.cc:407] Connection header received
0810 18:40:08.101392 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:08.101396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:08.101543 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:08.101682 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:08.102016 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.102718 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.104100 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.104511 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.104603 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.105038 (+ 435us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:08.105544 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:08.105663 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:08.105739 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 18:40:08.105803 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 18:40:08.114408 4147 raft_consensus.cc:1261] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 1 FOLLOWER]: Refusing update from remote peer c66955f278994fcd8b983a6f70f95711: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:08.114419 4006 raft_consensus.cc:1261] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 1 FOLLOWER]: Refusing update from remote peer c66955f278994fcd8b983a6f70f95711: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:08.115381 4235 consensus_queue.cc:1035] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fa5cda55e542219bf528f4919fe9fc" member_type: VOTER last_known_addr { host: "127.13.139.2" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:08.115778 4228 consensus_queue.cc:1035] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e1043e727e745fba7d78b529596ab06" member_type: VOTER last_known_addr { host: "127.13.139.3" port: 41657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:08.133106 4239 mvcc.cc:205] Tried to move back new op lower bound from 7317042004426801152 to 7317042004152209408. Current Snapshot: MvccSnapshot[applied={T|T < 7317042004426801152}]
I20260810 18:40:08.144044 3702 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:40:08.144344 3702 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 18:40:08.147713 3702 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 69820dc61260467abe43a249aeb33932: Sending DeleteTablet for 3 replicas of tablet 312b04c8001a4c4a85368d72fbbf75fa
I20260810 18:40:08.148908 3983 tablet_service.cc:1514] Processing DeleteTablet for tablet 312b04c8001a4c4a85368d72fbbf75fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:08 UTC) from {username='slave'} at 127.0.0.1:41624
I20260810 18:40:08.148921 4125 tablet_service.cc:1514] Processing DeleteTablet for tablet 312b04c8001a4c4a85368d72fbbf75fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:08 UTC) from {username='slave'} at 127.0.0.1:51120
I20260810 18:40:08.149058 3841 tablet_service.cc:1514] Processing DeleteTablet for tablet 312b04c8001a4c4a85368d72fbbf75fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 18:40:08 UTC) from {username='slave'} at 127.0.0.1:35594
I20260810 18:40:08.149950 4251 tablet_replica.cc:330] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: stopping tablet replica
I20260810 18:40:08.150542 4251 raft_consensus.cc:2229] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:40:08.150787 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 3766
I20260810 18:40:08.151314 4251 raft_consensus.cc:2258] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:08.152220 4253 tablet_replica.cc:330] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: stopping tablet replica
I20260810 18:40:08.152668 4253 raft_consensus.cc:2229] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 18:40:08.153218 4253 raft_consensus.cc:2258] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:08.154034 4251 ts_tablet_manager.cc:1905] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:08.161073 4251 ts_tablet_manager.cc:1918] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:40:08.161248 4251 log.cc:1196] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-2/wal/wals/312b04c8001a4c4a85368d72fbbf75fa
I20260810 18:40:08.161815 4251 ts_tablet_manager.cc:1939] T 312b04c8001a4c4a85368d72fbbf75fa P 2e1043e727e745fba7d78b529596ab06: Deleting consensus metadata
I20260810 18:40:08.163650 3688 catalog_manager.cc:4841] TS 2e1043e727e745fba7d78b529596ab06 (127.13.139.3:41657): tablet 312b04c8001a4c4a85368d72fbbf75fa (table test-table [id=06df4f5296f34ac3aa066ad834ae2f34]) successfully deleted
I20260810 18:40:08.165658 4253 ts_tablet_manager.cc:1905] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:08.171521 4254 tablet_replica.cc:330] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: stopping tablet replica
I20260810 18:40:08.171983 4254 raft_consensus.cc:2229] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 1 LEADER]: Raft consensus shutting down.
I20260810 18:40:08.172681 4254 raft_consensus.cc:2258] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 18:40:08.172715 4253 ts_tablet_manager.cc:1918] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 18:40:08.172883 4253 log.cc:1196] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Deleting WAL directory at /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786386879896169-13868-0/minicluster-data/ts-1/wal/wals/312b04c8001a4c4a85368d72fbbf75fa
I20260810 18:40:08.173460 4253 ts_tablet_manager.cc:1939] T 312b04c8001a4c4a85368d72fbbf75fa P 61fa5cda55e542219bf528f4919fe9fc: Deleting consensus metadata
I20260810 18:40:08.173457 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.154042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35604 (local address 127.13.139.1:36157)
0810 18:40:08.154250 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:08.154259 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:08.162599 (+ 8340us) server_negotiation.cc:407] Connection header received
0810 18:40:08.163164 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:08.163173 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:08.163314 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:08.163405 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:08.164284 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.165803 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.168338 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.169326 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.169450 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.171631 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:08.171642 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:08.171659 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:08.172462 (+ 803us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:08.172532 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:08.172565 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:08.172674 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:08.172927 (+ 253us) server_negotiation.cc:299] Negotiation successful
0810 18:40:08.173037 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 18:40:08.174609 3904 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:08.176224 3687 catalog_manager.cc:4841] TS 61fa5cda55e542219bf528f4919fe9fc (127.13.139.2:37643): tablet 312b04c8001a4c4a85368d72fbbf75fa (table test-table [id=06df4f5296f34ac3aa066ad834ae2f34]) successfully deleted
I20260810 18:40:08.175201 4254 ts_tablet_manager.cc:1905] T 312b04c8001a4c4a85368d72fbbf75fa P c66955f278994fcd8b983a6f70f95711: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 18:40:08.271088 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 3766
W20260810 18:40:08.293077 3687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.139.1:36157 (error 108)
I20260810 18:40:08.293962 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 3914
I20260810 18:40:08.295105 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.294647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35618)
0810 18:40:08.294861 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.294962 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 18:40:08.295334 3687 catalog_manager.cc:4584] TS c66955f278994fcd8b983a6f70f95711 (127.13.139.1:36157): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 312b04c8001a4c4a85368d72fbbf75fa: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
I20260810 18:40:08.301403 4221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.294769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41634 (local address 127.13.139.2:37643)
0810 18:40:08.295039 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:08.295047 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:08.295066 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:40:08.295315 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:08.295331 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:08.295414 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:08.295598 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:08.296022 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.296787 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.298123 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.298552 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.298688 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.300017 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:08.300025 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:08.300040 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:08.300624 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:08.300671 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:08.300692 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:08.300820 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:08.300963 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 18:40:08.301074 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260810 18:40:08.302083 4048 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:08.349269 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.348753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35630)
0810 18:40:08.349008 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.349104 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260810 18:40:08.350363 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.349999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35646)
0810 18:40:08.350141 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.350229 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 18:40:08.393512 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 3914
I20260810 18:40:08.411048 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.410441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35656)
0810 18:40:08.410716 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.410842 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260810 18:40:08.412271 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.411810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35666)
0810 18:40:08.412000 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.412098 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 18:40:08.413846 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4056
I20260810 18:40:08.421219 4217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.414690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51122 (local address 127.13.139.3:41657)
0810 18:40:08.414948 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:08.414955 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:08.414976 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:40:08.415041 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:08.415044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:08.415124 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:08.415250 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:08.415762 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.416519 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.417811 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:08.418228 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:08.418365 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:08.419675 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:08.419684 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:08.419698 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:08.420442 (+ 744us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:08.420494 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:08.420515 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:08.420650 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:08.420808 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 18:40:08.420921 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260810 18:40:08.421924 4194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:08.492846 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.492372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35680)
0810 18:40:08.492610 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.492701 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260810 18:40:08.494021 4215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:08.493529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.1:36157 (local address 127.0.0.1:35692)
0810 18:40:08.493770 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:08.493863 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.1:36157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260810 18:40:08.515064 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 4056
I20260810 18:40:08.535116 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 3670
I20260810 18:40:08.536360 3736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:08.645320 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 3670
2026-08-10T18:40:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2915 ms)
[----------] 6 tests from EncryptionPolicyTest (22524 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:08 dist-test-slave-5k54 krb5kdc[4263](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:08 dist-test-slave-5k54 krb5kdc[4263](info): set up 2 sockets
Aug 10 18:40:08 dist-test-slave-5k54 krb5kdc[4263](info): commencing operation
krb5kdc: starting...
W20260810 18:40:09.879177 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.001s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:10 dist-test-slave-5k54 krb5kdc[4263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387210, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:10.194440 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:10.536689 4279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:10.536994 4279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:10.537192 4279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:10.544576 4279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:10.544716 4279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:10.544827 4279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:10.544938 4279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:10.545028 4279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:10.554931 4279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41583
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:10.556304 4279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:10.557667 4279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:10.569895 4287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:10.569957 4285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:10.570127 4284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:10.571179 4279 server_base.cc:1034] running on GCE node
I20260810 18:40:10.572058 4279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:10.573508 4279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:10.574761 4279 hybrid_clock.cc:648] HybridClock initialized: now 1786387210574703 us; error 58 us; skew 500 ppm
I20260810 18:40:10.575132 4279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:10 dist-test-slave-5k54 krb5kdc[4263](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387210, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:10.578501 4279 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:10.580093 4279 webserver.cc:460] Webserver started at http://127.0.0.1:36239/ using document root <none> and password file <none>
I20260810 18:40:10.580737 4279 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:10.580847 4279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:10.581102 4279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:10.584219 4279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c"
format_stamp: "Formatted at 2026-08-10 18:40:10 on dist-test-slave-5k54"
server_key: "a65da1d868532239f648f535113f431f"
server_key_iv: "be6ddd24db0609fab8598b76cc5d4188"
server_key_version: "encryptionkey@0"
I20260810 18:40:10.584970 4279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c"
format_stamp: "Formatted at 2026-08-10 18:40:10 on dist-test-slave-5k54"
server_key: "a65da1d868532239f648f535113f431f"
server_key_iv: "be6ddd24db0609fab8598b76cc5d4188"
server_key_version: "encryptionkey@0"
I20260810 18:40:10.590071 4279 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:40:10.593474 4297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:10.594771 4279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260810 18:40:10.594920 4279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c"
format_stamp: "Formatted at 2026-08-10 18:40:10 on dist-test-slave-5k54"
server_key: "a65da1d868532239f648f535113f431f"
server_key_iv: "be6ddd24db0609fab8598b76cc5d4188"
server_key_version: "encryptionkey@0"
I20260810 18:40:10.595083 4279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:10.616454 4279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:10.620545 4279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:10.620780 4279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:10.639662 4279 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41583
I20260810 18:40:10.639695 4355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41583 every 8 connection(s)
I20260810 18:40:10.641076 4279 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:10.645051 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 4279
I20260810 18:40:10.645126 4356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:10.645298 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:10.646168 13868 external_mini_cluster.cc:1428] Setting key 8c778bf242790813dc62df1f3b156935
I20260810 18:40:10.659545 4356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c: Bootstrap starting.
Aug 10 18:40:10 dist-test-slave-5k54 krb5kdc[4263](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387210, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 18:40:10.663305 4356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:10.664561 4356 log.cc:824] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:10.667953 4356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c: No bootstrap required, opened a new log
I20260810 18:40:10.671633 4359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:10.648251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49393 (local address 127.0.0.1:41583)
0810 18:40:10.649059 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:10.649070 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:10.649111 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:40:10.651380 (+ 2269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:10.651402 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:10.652001 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:10.652341 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:10.654192 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:10.655575 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:10.657579 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:10.658241 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:10.658367 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:10.663262 (+ 4895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:10.663270 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:10.663283 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:10.663326 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:10.666889 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:10.667938 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:10.667948 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:10.667954 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:10.668216 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:10.668772 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:10.668775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:10.668777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:10.669308 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:10.669545 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:10.670175 (+ 630us) server_negotiation.cc:299] Negotiation successful
0810 18:40:10.670565 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":400,"threads_started":1}
I20260810 18:40:10.675962 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:10.677564 4356 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41583 } }
I20260810 18:40:10.677981 4356 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:10.678073 4356 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5a4661ea1f4f4dbc478f07967c2d9c, State: Initialized, Role: FOLLOWER
I20260810 18:40:10.678728 4356 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41583 } }
I20260810 18:40:10.679049 4356 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:10.679194 4356 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:10.679375 4356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:10.682518 4356 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41583 } }
I20260810 18:40:10.683128 4356 leader_election.cc:302] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa5a4661ea1f4f4dbc478f07967c2d9c; no voters:
I20260810 18:40:10.683773 4356 leader_election.cc:288] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:10.683916 4367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:10.685338 4367 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [term 1 LEADER]: Becoming Leader. State: Replica: aa5a4661ea1f4f4dbc478f07967c2d9c, State: Running, Role: LEADER
I20260810 18:40:10.685953 4367 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41583 } }
I20260810 18:40:10.686151 4356 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:10.699525 4368 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41583 } } }
I20260810 18:40:10.700063 4368 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:10.701297 4369 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa5a4661ea1f4f4dbc478f07967c2d9c. Latest consensus state: current_term: 1 leader_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa5a4661ea1f4f4dbc478f07967c2d9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41583 } } }
I20260810 18:40:10.701668 4359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:10.681924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60829 (local address 127.0.0.1:41583)
0810 18:40:10.682110 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:10.682116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:10.682572 (+ 456us) server_negotiation.cc:407] Connection header received
0810 18:40:10.682699 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:10.682703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:10.682783 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:10.682890 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:10.685035 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:10.686338 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:10.688280 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:10.689163 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:10.689321 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:10.693204 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:10.693214 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:10.693222 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:10.693272 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:10.698094 (+ 4822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:10.699189 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:10.699195 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:10.699199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:10.699337 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:10.699878 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:10.699883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:10.699887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:10.700356 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:10.700643 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:10.701057 (+ 414us) server_negotiation.cc:299] Negotiation successful
0810 18:40:10.701232 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:40:10.702171 4369 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:10.707072 4380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:10.712355 4380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:10.721390 4380 catalog_manager.cc:1347] Generated new cluster ID: bed223d66c71443c8d9c906e6623be1a
I20260810 18:40:10.721509 4380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:10.749310 4380 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:10.751283 4380 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:10.759392 4380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa5a4661ea1f4f4dbc478f07967c2d9c: Generated new TSK 0
I20260810 18:40:10.760277 4380 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:10.775240 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4279
I20260810 18:40:10.777146 4351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:10.874230 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 4279
W20260810 18:40:10.896265 4261 connection.cc:535] client connection to 127.0.0.1:41583 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41583): Connection reset by peer (error 104)
2026-08-10T18:40:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2217 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:10 dist-test-slave-5k54 krb5kdc[4391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:10 dist-test-slave-5k54 krb5kdc[4391](info): set up 2 sockets
Aug 10 18:40:10 dist-test-slave-5k54 krb5kdc[4391](info): commencing operation
krb5kdc: starting...
W20260810 18:40:12.049710 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.008s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:12 dist-test-slave-5k54 krb5kdc[4391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:12.363303 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44581
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:12.702416 4408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:12.702759 4408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:12.702946 4408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:12.710248 4408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:12.710410 4408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:12.710525 4408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:12.710637 4408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:12.710727 4408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:12.720825 4408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44581
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:12.722223 4408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:12.723583 4408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:12.736042 4413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:12.735992 4414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:12.735999 4416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:12.737205 4408 server_base.cc:1034] running on GCE node
I20260810 18:40:12.738021 4408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:12.739547 4408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:12.740783 4408 hybrid_clock.cc:648] HybridClock initialized: now 1786387212740728 us; error 43 us; skew 500 ppm
I20260810 18:40:12.741153 4408 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:12 dist-test-slave-5k54 krb5kdc[4391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387212, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:12.748320 4408 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:12.749881 4408 webserver.cc:460] Webserver started at http://127.0.0.1:43697/ using document root <none> and password file <none>
I20260810 18:40:12.750552 4408 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:12.750674 4408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:12.751022 4408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:12.754725 4408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "10d8eea8cce84454be554ebeac75db31"
format_stamp: "Formatted at 2026-08-10 18:40:12 on dist-test-slave-5k54"
server_key: "6875b4d949d05ff2b3e404feb6740adb"
server_key_iv: "337e0c63761b2c8443d76d0a78413a3d"
server_key_version: "encryptionkey@0"
I20260810 18:40:12.755707 4408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "10d8eea8cce84454be554ebeac75db31"
format_stamp: "Formatted at 2026-08-10 18:40:12 on dist-test-slave-5k54"
server_key: "6875b4d949d05ff2b3e404feb6740adb"
server_key_iv: "337e0c63761b2c8443d76d0a78413a3d"
server_key_version: "encryptionkey@0"
I20260810 18:40:12.761431 4408 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:40:12.765406 4423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:12.766907 4408 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:40:12.767061 4408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "10d8eea8cce84454be554ebeac75db31"
format_stamp: "Formatted at 2026-08-10 18:40:12 on dist-test-slave-5k54"
server_key: "6875b4d949d05ff2b3e404feb6740adb"
server_key_iv: "337e0c63761b2c8443d76d0a78413a3d"
server_key_version: "encryptionkey@0"
I20260810 18:40:12.767247 4408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:12.787251 4408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:12.791524 4408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:12.791764 4408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:12.811237 4408 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44581
I20260810 18:40:12.811283 4479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44581 every 8 connection(s)
I20260810 18:40:12.812696 4408 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:12.813380 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 4408
I20260810 18:40:12.813628 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:12.814177 13868 external_mini_cluster.cc:1428] Setting key 425f9ef363fa75d899ce2ed49c5e20f1
I20260810 18:40:12.817246 4480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:12.828161 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:12.816094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55757 (local address 127.0.0.1:44581)
0810 18:40:12.816945 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:12.816961 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:12.817016 (+ 55us) server_negotiation.cc:407] Connection header received
0810 18:40:12.818739 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:12.818760 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:12.819174 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:12.819569 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:12.820142 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:12.821483 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:12.823369 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:12.824100 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:12.824227 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:12.825616 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:12.825623 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:12.825636 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:12.826210 (+ 574us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:12.826286 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:12.826315 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:12.826443 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:12.826806 (+ 363us) server_negotiation.cc:299] Negotiation successful
0810 18:40:12.827049 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":381,"threads_started":1}
I20260810 18:40:12.829850 4480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31: Bootstrap starting.
I20260810 18:40:12.832149 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:12.833477 4480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:12.834746 4480 log.cc:824] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:12.837826 4480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31: No bootstrap required, opened a new log
I20260810 18:40:12.844635 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:12.837496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36587 (local address 127.0.0.1:44581)
0810 18:40:12.837715 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:12.837724 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:12.838226 (+ 502us) server_negotiation.cc:407] Connection header received
0810 18:40:12.838427 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:12.838431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:12.838490 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:12.838570 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:12.839179 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:12.840029 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:12.841986 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:12.842439 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:12.842528 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:12.843817 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:12.843822 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:12.843826 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:12.843843 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:12.843892 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:12.843911 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:12.844010 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:12.844211 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 18:40:12.844256 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:40:12.847362 4480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8eea8cce84454be554ebeac75db31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260810 18:40:12.847820 4480 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:12.847941 4480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d8eea8cce84454be554ebeac75db31, State: Initialized, Role: FOLLOWER
I20260810 18:40:12.848506 4480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8eea8cce84454be554ebeac75db31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260810 18:40:12.848743 4480 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:12.848902 4480 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:12.849078 4480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:12.851298 4480 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8eea8cce84454be554ebeac75db31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260810 18:40:12.851886 4480 leader_election.cc:302] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10d8eea8cce84454be554ebeac75db31; no voters:
I20260810 18:40:12.852545 4480 leader_election.cc:288] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:12.852624 4492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:12.853350 4492 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [term 1 LEADER]: Becoming Leader. State: Replica: 10d8eea8cce84454be554ebeac75db31, State: Running, Role: LEADER
I20260810 18:40:12.853926 4492 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8eea8cce84454be554ebeac75db31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } }
I20260810 18:40:12.854681 4480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:12.856922 4493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10d8eea8cce84454be554ebeac75db31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8eea8cce84454be554ebeac75db31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } } }
I20260810 18:40:12.857270 4493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:12.857683 4494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10d8eea8cce84454be554ebeac75db31. Latest consensus state: current_term: 1 leader_uuid: "10d8eea8cce84454be554ebeac75db31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d8eea8cce84454be554ebeac75db31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44581 } } }
I20260810 18:40:12.857985 4494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:12.860754 4499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:12.866241 4499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:12.876451 4499 catalog_manager.cc:1347] Generated new cluster ID: 3335edc68a624af49c93d1716245ea1c
I20260810 18:40:12.876574 4499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:12.916000 4499 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:12.917541 4499 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:12.925925 4499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10d8eea8cce84454be554ebeac75db31: Generated new TSK 0
I20260810 18:40:12.926880 4499 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:12.948222 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4408
W20260810 18:40:12.949383 4475 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55757
W20260810 18:40:12.950103 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4408: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:12.950284 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 4408
W20260810 18:40:12.971262 4389 connection.cc:535] client connection to 127.0.0.1:44581 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44581): Connection reset by peer (error 104)
2026-08-10T18:40:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2075 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:13 dist-test-slave-5k54 krb5kdc[4515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:13 dist-test-slave-5k54 krb5kdc[4515](info): set up 2 sockets
Aug 10 18:40:13 dist-test-slave-5k54 krb5kdc[4515](info): commencing operation
krb5kdc: starting...
W20260810 18:40:14.146093 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:14 dist-test-slave-5k54 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387214, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:14.459370 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33103
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:14.814213 4528 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:14.814494 4528 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:14.814661 4528 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:14.822615 4528 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:14.822737 4528 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:14.822846 4528 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:14.822914 4528 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:14.822995 4528 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:14.833143 4528 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33103
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:14.834452 4528 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:14.835870 4528 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:14.848069 4533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:14.848083 4536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:14.848116 4534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:14.849124 4528 server_base.cc:1034] running on GCE node
I20260810 18:40:14.850000 4528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:14.851401 4528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:14.852742 4528 hybrid_clock.cc:648] HybridClock initialized: now 1786387214852644 us; error 56 us; skew 500 ppm
I20260810 18:40:14.853247 4528 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:14 dist-test-slave-5k54 krb5kdc[4515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387214, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:14.857903 4528 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:14.860448 4528 webserver.cc:460] Webserver started at http://127.0.0.1:41789/ using document root <none> and password file <none>
I20260810 18:40:14.861413 4528 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:14.861572 4528 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:14.861901 4528 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:14.865015 4528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "b8e65083cdfd48aaba66f26bb38679f2"
format_stamp: "Formatted at 2026-08-10 18:40:14 on dist-test-slave-5k54"
server_key: "346ad8821f9a13c13840d62e6c081507"
server_key_iv: "574c1ba29da8c77d0af864c95c5fbade"
server_key_version: "encryptionkey@0"
I20260810 18:40:14.865785 4528 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "b8e65083cdfd48aaba66f26bb38679f2"
format_stamp: "Formatted at 2026-08-10 18:40:14 on dist-test-slave-5k54"
server_key: "346ad8821f9a13c13840d62e6c081507"
server_key_iv: "574c1ba29da8c77d0af864c95c5fbade"
server_key_version: "encryptionkey@0"
I20260810 18:40:14.871733 4528 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260810 18:40:14.876467 4544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:14.877739 4528 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:14.877928 4528 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "b8e65083cdfd48aaba66f26bb38679f2"
format_stamp: "Formatted at 2026-08-10 18:40:14 on dist-test-slave-5k54"
server_key: "346ad8821f9a13c13840d62e6c081507"
server_key_iv: "574c1ba29da8c77d0af864c95c5fbade"
server_key_version: "encryptionkey@0"
I20260810 18:40:14.878135 4528 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:14.883817 4528 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:14.887717 4528 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:14.888007 4528 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:14.906052 4528 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33103
I20260810 18:40:14.906095 4603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33103 every 8 connection(s)
I20260810 18:40:14.907521 4528 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:14.910975 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 4528
I20260810 18:40:14.911188 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:14.911235 4604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:14.911762 13868 external_mini_cluster.cc:1428] Setting key 1e40f2a835b039eb126afc0446223f2d
I20260810 18:40:14.920073 4607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:14.913585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57115 (local address 127.0.0.1:33103)
0810 18:40:14.914467 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:14.914482 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:14.914537 (+ 55us) server_negotiation.cc:407] Connection header received
0810 18:40:14.916320 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:14.916347 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:14.916794 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:14.917219 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:14.918188 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:14.918196 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:14.918217 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:14.918238 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:14.918301 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:14.918347 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:14.918564 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:14.918694 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 18:40:14.918880 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":358,"threads_started":1}
I20260810 18:40:14.923661 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:14.925740 4604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2: Bootstrap starting.
I20260810 18:40:14.929122 4604 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:14.930241 4604 log.cc:824] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:14.930680 4607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:14.928168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49311 (local address 127.0.0.1:33103)
0810 18:40:14.928349 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:14.928355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:14.928698 (+ 343us) server_negotiation.cc:407] Connection header received
0810 18:40:14.928823 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:14.928830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:14.928888 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:14.929000 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:14.930039 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:14.930046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:14.930052 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:14.930073 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:14.930114 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:14.930133 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:14.930260 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:14.930325 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 18:40:14.930380 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:40:14.933267 4604 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2: No bootstrap required, opened a new log
I20260810 18:40:14.940402 4604 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e65083cdfd48aaba66f26bb38679f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33103 } }
I20260810 18:40:14.940738 4604 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:14.940824 4604 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8e65083cdfd48aaba66f26bb38679f2, State: Initialized, Role: FOLLOWER
I20260810 18:40:14.941301 4604 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e65083cdfd48aaba66f26bb38679f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33103 } }
I20260810 18:40:14.941497 4604 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:14.941592 4604 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:14.941751 4604 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:14.944252 4604 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e65083cdfd48aaba66f26bb38679f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33103 } }
I20260810 18:40:14.944677 4604 leader_election.cc:302] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8e65083cdfd48aaba66f26bb38679f2; no voters:
I20260810 18:40:14.945205 4604 leader_election.cc:288] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:14.945369 4614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:14.946017 4614 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [term 1 LEADER]: Becoming Leader. State: Replica: b8e65083cdfd48aaba66f26bb38679f2, State: Running, Role: LEADER
I20260810 18:40:14.946583 4614 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e65083cdfd48aaba66f26bb38679f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33103 } }
I20260810 18:40:14.947244 4604 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:14.949329 4617 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8e65083cdfd48aaba66f26bb38679f2. Latest consensus state: current_term: 1 leader_uuid: "b8e65083cdfd48aaba66f26bb38679f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e65083cdfd48aaba66f26bb38679f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33103 } } }
I20260810 18:40:14.949731 4617 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:14.949656 4615 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8e65083cdfd48aaba66f26bb38679f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8e65083cdfd48aaba66f26bb38679f2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33103 } } }
I20260810 18:40:14.950048 4615 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:14.950834 4620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:14.956868 4620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:14.965636 4620 catalog_manager.cc:1347] Generated new cluster ID: 8798baeca67d4f45bed5c117d594acfe
I20260810 18:40:14.965780 4620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:14.990132 4620 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:14.990569 4620 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:15.005275 4620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8e65083cdfd48aaba66f26bb38679f2: Generated new TSK 0
I20260810 18:40:15.006155 4620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:15.016767 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4528
W20260810 18:40:15.017907 4598 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57115
W20260810 18:40:15.018646 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4528: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:15.018822 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 4528
2026-08-10T18:40:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2068 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:15 dist-test-slave-5k54 krb5kdc[4640](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:15 dist-test-slave-5k54 krb5kdc[4640](info): set up 2 sockets
Aug 10 18:40:15 dist-test-slave-5k54 krb5kdc[4640](info): commencing operation
krb5kdc: starting...
W20260810 18:40:16.252003 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.008s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:16 dist-test-slave-5k54 krb5kdc[4640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387216, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:16.572278 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34903
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:16.916435 4656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:16.916733 4656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:16.916915 4656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:16.924216 4656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:16.924327 4656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:16.924441 4656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:16.924574 4656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:16.924654 4656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:16.934579 4656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:16.935933 4656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:16.937235 4656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:16.949056 4661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:16.949155 4662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:16.949362 4664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:16.950201 4656 server_base.cc:1034] running on GCE node
I20260810 18:40:16.950924 4656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:16.952360 4656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:16.953572 4656 hybrid_clock.cc:648] HybridClock initialized: now 1786387216953514 us; error 41 us; skew 500 ppm
I20260810 18:40:16.953928 4656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:16 dist-test-slave-5k54 krb5kdc[4640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387216, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:16.957237 4656 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:16.958652 4656 webserver.cc:460] Webserver started at http://127.0.0.1:35073/ using document root <none> and password file <none>
I20260810 18:40:16.959332 4656 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:16.959489 4656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:16.959813 4656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:16.962777 4656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "1cde72cdbc5743458a76587483551de5"
format_stamp: "Formatted at 2026-08-10 18:40:16 on dist-test-slave-5k54"
server_key: "426eb55b1ff8f2bfbb8e6b1bf8154e14"
server_key_iv: "63b510bd48c488a1488d518a0175f6e6"
server_key_version: "encryptionkey@0"
I20260810 18:40:16.963618 4656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "1cde72cdbc5743458a76587483551de5"
format_stamp: "Formatted at 2026-08-10 18:40:16 on dist-test-slave-5k54"
server_key: "426eb55b1ff8f2bfbb8e6b1bf8154e14"
server_key_iv: "63b510bd48c488a1488d518a0175f6e6"
server_key_version: "encryptionkey@0"
I20260810 18:40:16.968698 4656 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260810 18:40:16.972177 4671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:16.973482 4656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:16.973663 4656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "1cde72cdbc5743458a76587483551de5"
format_stamp: "Formatted at 2026-08-10 18:40:16 on dist-test-slave-5k54"
server_key: "426eb55b1ff8f2bfbb8e6b1bf8154e14"
server_key_iv: "63b510bd48c488a1488d518a0175f6e6"
server_key_version: "encryptionkey@0"
I20260810 18:40:16.973856 4656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:17.014653 4656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:17.019122 4656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:17.019459 4656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:17.038930 4656 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34903
I20260810 18:40:17.038975 4730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34903 every 8 connection(s)
I20260810 18:40:17.040467 4656 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:17.042265 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 4656
I20260810 18:40:17.042474 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:17.043041 13868 external_mini_cluster.cc:1428] Setting key 68449f7135d2d89591a44131d23f643e
I20260810 18:40:17.045217 4731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 18:40:17 dist-test-slave-5k54 krb5kdc[4640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387216, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 18:40:17.058573 4731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5: Bootstrap starting.
I20260810 18:40:17.062816 4731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:17.064127 4731 log.cc:824] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:17.067607 4731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5: No bootstrap required, opened a new log
I20260810 18:40:17.067819 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:17.044928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54389 (local address 127.0.0.1:34903)
0810 18:40:17.045734 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:17.045745 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:17.045789 (+ 44us) server_negotiation.cc:407] Connection header received
0810 18:40:17.047401 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:17.047469 (+ 68us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:17.047878 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:17.048221 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:17.050099 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:17.051571 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:17.053351 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:17.054030 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:17.054167 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:17.059043 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:17.059054 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:17.059072 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:17.059122 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:17.063226 (+ 4104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:17.064101 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:17.064115 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:17.064125 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:17.064348 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:17.064788 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:17.064797 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:17.064802 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:17.065375 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:17.065676 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:17.066066 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 18:40:17.066493 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":373,"threads_started":1}
I20260810 18:40:17.071738 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:17.076421 4731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cde72cdbc5743458a76587483551de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34903 } }
I20260810 18:40:17.076912 4731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:17.077044 4731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cde72cdbc5743458a76587483551de5, State: Initialized, Role: FOLLOWER
I20260810 18:40:17.077687 4731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cde72cdbc5743458a76587483551de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34903 } }
I20260810 18:40:17.077999 4731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:17.078157 4731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:17.078329 4731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:17.081238 4731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cde72cdbc5743458a76587483551de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34903 } }
I20260810 18:40:17.081838 4731 leader_election.cc:302] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cde72cdbc5743458a76587483551de5; no voters:
I20260810 18:40:17.082535 4731 leader_election.cc:288] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:17.082705 4741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:17.083638 4741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [term 1 LEADER]: Becoming Leader. State: Replica: 1cde72cdbc5743458a76587483551de5, State: Running, Role: LEADER
I20260810 18:40:17.084254 4741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cde72cdbc5743458a76587483551de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34903 } }
I20260810 18:40:17.084697 4731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:17.088109 4742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cde72cdbc5743458a76587483551de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cde72cdbc5743458a76587483551de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34903 } } }
I20260810 18:40:17.088639 4742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:17.089214 4743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cde72cdbc5743458a76587483551de5. Latest consensus state: current_term: 1 leader_uuid: "1cde72cdbc5743458a76587483551de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cde72cdbc5743458a76587483551de5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34903 } } }
I20260810 18:40:17.089591 4743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:17.096585 4734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:17.076114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41589 (local address 127.0.0.1:34903)
0810 18:40:17.076293 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:17.076299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:17.076735 (+ 436us) server_negotiation.cc:407] Connection header received
0810 18:40:17.076951 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:17.076957 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:17.077060 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:17.077188 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:17.078958 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:17.080228 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:17.081664 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:17.082352 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:17.082527 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:17.085997 (+ 3470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:17.086005 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:17.086013 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:17.086063 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:17.091207 (+ 5144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:17.092389 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:17.092398 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:17.092417 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:17.092634 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:17.093228 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:17.093236 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:17.093241 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:17.093727 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:17.095547 (+ 1820us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:17.095734 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 18:40:17.096041 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 18:40:17.097262 4746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:17.102602 4746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:17.111722 4746 catalog_manager.cc:1347] Generated new cluster ID: 95e211fc7c1447dda4348e64ed2afba4
I20260810 18:40:17.111842 4746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:17.132170 4746 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:17.133827 4746 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:17.141747 4746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1cde72cdbc5743458a76587483551de5: Generated new TSK 0
I20260810 18:40:17.142709 4746 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:17.156085 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4656
I20260810 18:40:17.157575 4725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:17.249831 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 4656
2026-08-10T18:40:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2230 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:17 dist-test-slave-5k54 krb5kdc[4767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:17 dist-test-slave-5k54 krb5kdc[4767](info): set up 2 sockets
Aug 10 18:40:17 dist-test-slave-5k54 krb5kdc[4767](info): commencing operation
krb5kdc: starting...
W20260810 18:40:18.430145 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.002s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:18 dist-test-slave-5k54 krb5kdc[4767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387218, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:18.758039 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33417
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33417
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:19.138892 4781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:19.139251 4781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:19.139412 4781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:19.146756 4781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:19.146921 4781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:19.147017 4781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:19.147125 4781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:19.147209 4781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:19.157418 4781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:19.158799 4781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:19.160147 4781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:19.172108 4788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:19.172214 4792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:19.172209 4790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:19.173319 4781 server_base.cc:1034] running on GCE node
I20260810 18:40:19.174095 4781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:19.175511 4781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:19.176733 4781 hybrid_clock.cc:648] HybridClock initialized: now 1786387219176689 us; error 54 us; skew 500 ppm
I20260810 18:40:19.177070 4781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:19 dist-test-slave-5k54 krb5kdc[4767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387219, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:19.185276 4781 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:19.186746 4781 webserver.cc:460] Webserver started at http://127.0.0.1:42803/ using document root <none> and password file <none>
I20260810 18:40:19.187496 4781 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:19.187647 4781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:19.187958 4781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:19.191097 4781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "955cb4a7a25d490281569c721b9711d8"
format_stamp: "Formatted at 2026-08-10 18:40:19 on dist-test-slave-5k54"
server_key: "71dd591e6d3b37d6bf301d0e7c06300c"
server_key_iv: "e0b353bf37cbd62e4dc200ee6388d94a"
server_key_version: "encryptionkey@0"
I20260810 18:40:19.191883 4781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "955cb4a7a25d490281569c721b9711d8"
format_stamp: "Formatted at 2026-08-10 18:40:19 on dist-test-slave-5k54"
server_key: "71dd591e6d3b37d6bf301d0e7c06300c"
server_key_iv: "e0b353bf37cbd62e4dc200ee6388d94a"
server_key_version: "encryptionkey@0"
I20260810 18:40:19.196923 4781 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260810 18:40:19.200337 4799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:19.201624 4781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 18:40:19.201819 4781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "955cb4a7a25d490281569c721b9711d8"
format_stamp: "Formatted at 2026-08-10 18:40:19 on dist-test-slave-5k54"
server_key: "71dd591e6d3b37d6bf301d0e7c06300c"
server_key_iv: "e0b353bf37cbd62e4dc200ee6388d94a"
server_key_version: "encryptionkey@0"
I20260810 18:40:19.202028 4781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:19.228376 4781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:19.232605 4781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:19.232911 4781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:19.251634 4781 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33417
I20260810 18:40:19.251654 4857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33417 every 8 connection(s)
I20260810 18:40:19.253043 4781 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:19.256871 4858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:19.260185 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 4781
I20260810 18:40:19.260398 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:19.260983 13868 external_mini_cluster.cc:1428] Setting key 5bf7733447111dfc951a3724562c1a26
I20260810 18:40:19.269394 4858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8: Bootstrap starting.
I20260810 18:40:19.273166 4858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:19.274286 4858 log.cc:824] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:19.274654 4861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:19.262841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56659 (local address 127.0.0.1:33417)
0810 18:40:19.263651 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:19.263662 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:19.263703 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:40:19.265390 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:19.265412 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:19.265809 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:19.266133 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:19.266754 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:19.268199 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:19.270111 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:19.270752 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:19.270880 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:19.272296 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:19.272304 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:19.272317 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:19.272836 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:19.272913 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:19.272937 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:19.273046 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:19.273318 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 18:40:19.273629 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":382,"threads_started":1}
I20260810 18:40:19.277136 4858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8: No bootstrap required, opened a new log
I20260810 18:40:19.278324 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:19.287281 4858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "955cb4a7a25d490281569c721b9711d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33417 } }
I20260810 18:40:19.287806 4858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:19.287933 4858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 955cb4a7a25d490281569c721b9711d8, State: Initialized, Role: FOLLOWER
I20260810 18:40:19.288627 4858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "955cb4a7a25d490281569c721b9711d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33417 } }
I20260810 18:40:19.288838 4858 raft_consensus.cc:388] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:19.288996 4858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:19.289186 4858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:19.290239 4861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:19.283579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43687 (local address 127.0.0.1:33417)
0810 18:40:19.283771 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:19.283777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:19.284283 (+ 506us) server_negotiation.cc:407] Connection header received
0810 18:40:19.284446 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:19.284452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:19.284533 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:19.284640 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:19.285141 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:19.286269 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:19.287580 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:19.288264 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:19.288401 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:19.289509 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:19.289514 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:19.289518 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:19.289535 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:19.289571 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:19.289585 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:19.289654 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:19.289832 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 18:40:19.289902 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:40:19.291955 4858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "955cb4a7a25d490281569c721b9711d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33417 } }
I20260810 18:40:19.292444 4858 leader_election.cc:302] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 955cb4a7a25d490281569c721b9711d8; no voters:
I20260810 18:40:19.293009 4858 leader_election.cc:288] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:19.293131 4869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:19.293862 4869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [term 1 LEADER]: Becoming Leader. State: Replica: 955cb4a7a25d490281569c721b9711d8, State: Running, Role: LEADER
I20260810 18:40:19.294441 4869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "955cb4a7a25d490281569c721b9711d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33417 } }
I20260810 18:40:19.295231 4858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:19.297156 4871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 955cb4a7a25d490281569c721b9711d8. Latest consensus state: current_term: 1 leader_uuid: "955cb4a7a25d490281569c721b9711d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "955cb4a7a25d490281569c721b9711d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33417 } } }
I20260810 18:40:19.297252 4870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "955cb4a7a25d490281569c721b9711d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "955cb4a7a25d490281569c721b9711d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33417 } } }
I20260810 18:40:19.297647 4870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:19.297647 4871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:19.298950 4877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:19.304901 4877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:19.313654 4877 catalog_manager.cc:1347] Generated new cluster ID: 887d64ff6fae4c5a800469a13f17513d
I20260810 18:40:19.313778 4877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:19.336580 4877 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:19.337919 4877 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:19.346747 4877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 955cb4a7a25d490281569c721b9711d8: Generated new TSK 0
I20260810 18:40:19.347896 4877 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:19.359472 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4781
W20260810 18:40:19.360601 4853 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56659
W20260810 18:40:19.361338 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4781: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:19.361490 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 4781
2026-08-10T18:40:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2108 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:19 dist-test-slave-5k54 krb5kdc[4891](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:19 dist-test-slave-5k54 krb5kdc[4891](info): set up 2 sockets
Aug 10 18:40:19 dist-test-slave-5k54 krb5kdc[4891](info): commencing operation
krb5kdc: starting...
W20260810 18:40:20.559888 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:20 dist-test-slave-5k54 krb5kdc[4891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:20.890899 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37635
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:21.235673 4908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:21.235991 4908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:21.236088 4908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:21.243243 4908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:21.243353 4908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:21.243399 4908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:21.243547 4908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:21.243598 4908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:21.253401 4908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:21.254654 4908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:21.255939 4908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:21.267664 4913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:21.267699 4914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:21.268260 4916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:21.268774 4908 server_base.cc:1034] running on GCE node
I20260810 18:40:21.269459 4908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:21.270747 4908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:21.271960 4908 hybrid_clock.cc:648] HybridClock initialized: now 1786387221271904 us; error 49 us; skew 500 ppm
I20260810 18:40:21.272302 4908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:21 dist-test-slave-5k54 krb5kdc[4891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387221, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:21.275508 4908 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:21.277026 4908 webserver.cc:460] Webserver started at http://127.0.0.1:46323/ using document root <none> and password file <none>
I20260810 18:40:21.277631 4908 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:21.277731 4908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:21.277993 4908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:21.280898 4908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "f919269190fb402daa60ce6c15458a8b"
format_stamp: "Formatted at 2026-08-10 18:40:21 on dist-test-slave-5k54"
server_key: "595bfa8a7bcd7517bb603e68e440ad7f"
server_key_iv: "aa22a4c7fcfdaf3c04d3f641ce72c527"
server_key_version: "encryptionkey@0"
I20260810 18:40:21.281693 4908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "f919269190fb402daa60ce6c15458a8b"
format_stamp: "Formatted at 2026-08-10 18:40:21 on dist-test-slave-5k54"
server_key: "595bfa8a7bcd7517bb603e68e440ad7f"
server_key_iv: "aa22a4c7fcfdaf3c04d3f641ce72c527"
server_key_version: "encryptionkey@0"
I20260810 18:40:21.286707 4908 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:40:21.290097 4925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:21.291363 4908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:40:21.291617 4908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "f919269190fb402daa60ce6c15458a8b"
format_stamp: "Formatted at 2026-08-10 18:40:21 on dist-test-slave-5k54"
server_key: "595bfa8a7bcd7517bb603e68e440ad7f"
server_key_iv: "aa22a4c7fcfdaf3c04d3f641ce72c527"
server_key_version: "encryptionkey@0"
I20260810 18:40:21.291803 4908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:21.297219 4908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:21.301465 4908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:21.301762 4908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:21.320303 4908 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37635
I20260810 18:40:21.320397 4978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37635 every 8 connection(s)
I20260810 18:40:21.321708 4908 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:21.322197 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 4908
I20260810 18:40:21.322417 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:21.323135 13868 external_mini_cluster.cc:1428] Setting key 7371d0a051e75f3d914a1442ce6a8755
I20260810 18:40:21.326051 4979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:21.334059 4982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:21.325287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34311 (local address 127.0.0.1:37635)
0810 18:40:21.326242 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:21.326258 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:21.328368 (+ 2110us) server_negotiation.cc:407] Connection header received
0810 18:40:21.330588 (+ 2220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:21.330609 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:21.330940 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:21.331339 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:21.332474 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:21.332480 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:21.332492 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:21.332506 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:21.332565 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:21.332583 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:21.332836 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:21.332999 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 18:40:21.333179 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":392,"threads_started":1}
I20260810 18:40:21.338085 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:21.339968 4979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b: Bootstrap starting.
I20260810 18:40:21.343349 4979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:21.344779 4979 log.cc:824] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:21.345633 4982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:21.343001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50881 (local address 127.0.0.1:37635)
0810 18:40:21.343200 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:21.343206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:21.343586 (+ 380us) server_negotiation.cc:407] Connection header received
0810 18:40:21.343767 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:21.343771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:21.343831 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:21.343922 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:21.344832 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:21.344836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:21.344839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:21.344852 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:21.344915 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:21.344935 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:21.345070 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:21.345219 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 18:40:21.345298 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 18:40:21.347856 4979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b: No bootstrap required, opened a new log
I20260810 18:40:21.355068 4979 raft_consensus.cc:348] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f919269190fb402daa60ce6c15458a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260810 18:40:21.355389 4979 raft_consensus.cc:374] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:21.355530 4979 raft_consensus.cc:729] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f919269190fb402daa60ce6c15458a8b, State: Initialized, Role: FOLLOWER
I20260810 18:40:21.356091 4979 consensus_queue.cc:260] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f919269190fb402daa60ce6c15458a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260810 18:40:21.356297 4979 raft_consensus.cc:388] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:21.356395 4979 raft_consensus.cc:482] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:21.356514 4979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:21.358925 4979 raft_consensus.cc:504] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f919269190fb402daa60ce6c15458a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260810 18:40:21.359368 4979 leader_election.cc:302] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f919269190fb402daa60ce6c15458a8b; no voters:
I20260810 18:40:21.359972 4979 leader_election.cc:288] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:21.360108 4989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:21.360801 4989 raft_consensus.cc:686] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [term 1 LEADER]: Becoming Leader. State: Replica: f919269190fb402daa60ce6c15458a8b, State: Running, Role: LEADER
I20260810 18:40:21.361341 4989 consensus_queue.cc:237] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f919269190fb402daa60ce6c15458a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } }
I20260810 18:40:21.362071 4979 sys_catalog.cc:564] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:21.364164 4990 sys_catalog.cc:455] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f919269190fb402daa60ce6c15458a8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f919269190fb402daa60ce6c15458a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } } }
I20260810 18:40:21.364595 4990 sys_catalog.cc:458] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:21.364290 4991 sys_catalog.cc:455] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f919269190fb402daa60ce6c15458a8b. Latest consensus state: current_term: 1 leader_uuid: "f919269190fb402daa60ce6c15458a8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f919269190fb402daa60ce6c15458a8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37635 } } }
I20260810 18:40:21.365347 4991 sys_catalog.cc:458] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:21.368490 4994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:21.375077 4994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:21.383980 4994 catalog_manager.cc:1347] Generated new cluster ID: 4a9d4a4089194f37a07ec7cb4992de79
I20260810 18:40:21.384099 4994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:21.394728 4994 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:21.395251 4994 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:21.403990 4994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f919269190fb402daa60ce6c15458a8b: Generated new TSK 0
I20260810 18:40:21.404815 4994 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:21.414784 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4908
W20260810 18:40:21.415880 4974 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34311
W20260810 18:40:21.416576 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 4908: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:21.416729 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 4908
2026-08-10T18:40:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2056 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:21 dist-test-slave-5k54 krb5kdc[5010](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:21 dist-test-slave-5k54 krb5kdc[5010](info): set up 2 sockets
Aug 10 18:40:21 dist-test-slave-5k54 krb5kdc[5010](info): commencing operation
krb5kdc: starting...
W20260810 18:40:22.659101 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.001s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:22 dist-test-slave-5k54 krb5kdc[5010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:22.978725 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42935
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:23.315788 5025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:23.316066 5025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:23.316157 5025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:23.323241 5025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:23.323349 5025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:23.323396 5025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:23.323534 5025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:23.323587 5025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:23.333472 5025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:23.334851 5025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:23.336333 5025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:23.348335 5035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:23.348289 5033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:23.348616 5032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:23.349553 5025 server_base.cc:1034] running on GCE node
I20260810 18:40:23.350354 5025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:23.351732 5025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:23.352991 5025 hybrid_clock.cc:648] HybridClock initialized: now 1786387223352938 us; error 34 us; skew 500 ppm
I20260810 18:40:23.353368 5025 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:23 dist-test-slave-5k54 krb5kdc[5010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387223, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:23.356604 5025 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:23.358107 5025 webserver.cc:460] Webserver started at http://127.0.0.1:41175/ using document root <none> and password file <none>
I20260810 18:40:23.358776 5025 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:23.358958 5025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:23.359265 5025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:23.362195 5025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "af968e2a9f38477fbafc4316958e90ae"
format_stamp: "Formatted at 2026-08-10 18:40:23 on dist-test-slave-5k54"
server_key: "97dfc0c0ac9268870870f059e0f155d3"
server_key_iv: "71db61a62decec2132d4eca51afae16e"
server_key_version: "encryptionkey@0"
I20260810 18:40:23.362970 5025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "af968e2a9f38477fbafc4316958e90ae"
format_stamp: "Formatted at 2026-08-10 18:40:23 on dist-test-slave-5k54"
server_key: "97dfc0c0ac9268870870f059e0f155d3"
server_key_iv: "71db61a62decec2132d4eca51afae16e"
server_key_version: "encryptionkey@0"
I20260810 18:40:23.368027 5025 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260810 18:40:23.371368 5043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:23.372685 5025 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:23.372872 5025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "af968e2a9f38477fbafc4316958e90ae"
format_stamp: "Formatted at 2026-08-10 18:40:23 on dist-test-slave-5k54"
server_key: "97dfc0c0ac9268870870f059e0f155d3"
server_key_iv: "71db61a62decec2132d4eca51afae16e"
server_key_version: "encryptionkey@0"
I20260810 18:40:23.373083 5025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:23.401537 5025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:23.405776 5025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:23.406077 5025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:23.425170 5025 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42935
I20260810 18:40:23.425216 5098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42935 every 8 connection(s)
I20260810 18:40:23.426635 5025 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:23.430388 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5025
I20260810 18:40:23.430603 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:23.430722 5099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:23.431214 13868 external_mini_cluster.cc:1428] Setting key bdf5eaea86b842ad225ada73cadb7ff9
I20260810 18:40:23.443689 5099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae: Bootstrap starting.
Aug 10 18:40:23 dist-test-slave-5k54 krb5kdc[5010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 18:40:23.447094 5099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:23.448410 5099 log.cc:824] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:23.451192 5099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae: No bootstrap required, opened a new log
I20260810 18:40:23.453779 5102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:23.433203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:38589 (local address 127.0.0.1:42935)
0810 18:40:23.434013 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:23.434027 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:23.434067 (+ 40us) server_negotiation.cc:407] Connection header received
0810 18:40:23.435808 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:23.435830 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:23.436237 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:23.436661 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:23.438162 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:23.439473 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:23.440749 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:23.441474 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:23.441686 (+ 212us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:23.446205 (+ 4519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:23.446212 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:23.446226 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:23.446264 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:23.449533 (+ 3269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:23.450334 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:23.450340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:23.450347 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:23.450522 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:23.450998 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:23.451002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:23.451004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:23.451608 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:23.451987 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:23.452431 (+ 444us) server_negotiation.cc:299] Negotiation successful
0810 18:40:23.452789 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":331,"threads_started":1}
I20260810 18:40:23.457703 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:23.459508 5099 raft_consensus.cc:348] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af968e2a9f38477fbafc4316958e90ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260810 18:40:23.459877 5099 raft_consensus.cc:374] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:23.459970 5099 raft_consensus.cc:729] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af968e2a9f38477fbafc4316958e90ae, State: Initialized, Role: FOLLOWER
I20260810 18:40:23.460668 5099 consensus_queue.cc:260] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af968e2a9f38477fbafc4316958e90ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260810 18:40:23.460973 5099 raft_consensus.cc:388] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:23.461136 5099 raft_consensus.cc:482] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:23.461313 5099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:23.464035 5099 raft_consensus.cc:504] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af968e2a9f38477fbafc4316958e90ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260810 18:40:23.464525 5099 leader_election.cc:302] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af968e2a9f38477fbafc4316958e90ae; no voters:
I20260810 18:40:23.465256 5099 leader_election.cc:288] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:23.465368 5110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:23.466845 5110 raft_consensus.cc:686] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [term 1 LEADER]: Becoming Leader. State: Replica: af968e2a9f38477fbafc4316958e90ae, State: Running, Role: LEADER
I20260810 18:40:23.467561 5099 sys_catalog.cc:564] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:23.467396 5110 consensus_queue.cc:237] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af968e2a9f38477fbafc4316958e90ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260810 18:40:23.473165 5112 sys_catalog.cc:455] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af968e2a9f38477fbafc4316958e90ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af968e2a9f38477fbafc4316958e90ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } } }
I20260810 18:40:23.473577 5112 sys_catalog.cc:458] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:23.474259 5113 sys_catalog.cc:455] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader af968e2a9f38477fbafc4316958e90ae. Latest consensus state: current_term: 1 leader_uuid: "af968e2a9f38477fbafc4316958e90ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af968e2a9f38477fbafc4316958e90ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } } }
I20260810 18:40:23.482775 5113 sys_catalog.cc:458] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:23.483282 5102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:23.462318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:33419 (local address 127.0.0.1:42935)
0810 18:40:23.462543 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:23.462554 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:23.463116 (+ 562us) server_negotiation.cc:407] Connection header received
0810 18:40:23.463219 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:23.463224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:23.463301 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:23.463401 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:23.464931 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:23.466283 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:23.468123 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:23.468816 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:23.468996 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:23.473169 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:23.473176 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:23.473184 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:23.473228 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:23.477834 (+ 4606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:23.479048 (+ 1214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:23.479056 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:23.479062 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:23.479232 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:23.479951 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:23.479959 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:23.479965 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:23.480461 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:23.482170 (+ 1709us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:23.482405 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 18:40:23.482666 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 18:40:23.485008 5119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:23.490343 5119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:23.499776 5119 catalog_manager.cc:1347] Generated new cluster ID: bf7eca7b07b14f109a6cbb0eb04efbe5
I20260810 18:40:23.499888 5119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:23.522902 5119 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:23.524825 5119 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:23.536258 5119 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af968e2a9f38477fbafc4316958e90ae: Generated new TSK 0
I20260810 18:40:23.537441 5119 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:23.549952 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5025
I20260810 18:40:23.551600 5093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:23.644174 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5025
W20260810 18:40:23.664336 5008 connection.cc:535] client connection to 127.0.0.1:42935 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42935): Connection reset by peer (error 104)
2026-08-10T18:40:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2226 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:23 dist-test-slave-5k54 krb5kdc[5135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:23 dist-test-slave-5k54 krb5kdc[5135](info): set up 2 sockets
Aug 10 18:40:23 dist-test-slave-5k54 krb5kdc[5135](info): commencing operation
krb5kdc: starting...
W20260810 18:40:24.839499 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.004s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:25 dist-test-slave-5k54 krb5kdc[5135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:25.169195 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:25.510152 5149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:25.510497 5149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:25.510663 5149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:25.518126 5149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:25.518249 5149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:25.518371 5149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:25.518468 5149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:25.518534 5149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:25.528718 5149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:25.530023 5149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:25.531347 5149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:25.544441 5157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:25.544519 5154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:25.545218 5155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:25.546051 5149 server_base.cc:1034] running on GCE node
I20260810 18:40:25.546849 5149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:25.548343 5149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:25.549579 5149 hybrid_clock.cc:648] HybridClock initialized: now 1786387225549542 us; error 48 us; skew 500 ppm
I20260810 18:40:25.550026 5149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:25 dist-test-slave-5k54 krb5kdc[5135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387225, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:25.553251 5149 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:25.554744 5149 webserver.cc:460] Webserver started at http://127.0.0.1:33521/ using document root <none> and password file <none>
I20260810 18:40:25.555462 5149 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:25.555619 5149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:25.555954 5149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:25.558941 5149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "16e09972b3bf4fa485f106cb5d595618"
format_stamp: "Formatted at 2026-08-10 18:40:25 on dist-test-slave-5k54"
server_key: "c3e7c4809fbddc75e6e6f2aa719b0604"
server_key_iv: "17c16593ad517f6a59c1bc674bd702e7"
server_key_version: "encryptionkey@0"
I20260810 18:40:25.559728 5149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "16e09972b3bf4fa485f106cb5d595618"
format_stamp: "Formatted at 2026-08-10 18:40:25 on dist-test-slave-5k54"
server_key: "c3e7c4809fbddc75e6e6f2aa719b0604"
server_key_iv: "17c16593ad517f6a59c1bc674bd702e7"
server_key_version: "encryptionkey@0"
I20260810 18:40:25.564682 5149 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260810 18:40:25.568620 5164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:25.569949 5149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:25.570087 5149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "16e09972b3bf4fa485f106cb5d595618"
format_stamp: "Formatted at 2026-08-10 18:40:25 on dist-test-slave-5k54"
server_key: "c3e7c4809fbddc75e6e6f2aa719b0604"
server_key_iv: "17c16593ad517f6a59c1bc674bd702e7"
server_key_version: "encryptionkey@0"
I20260810 18:40:25.570241 5149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:25.593003 5149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:25.596987 5149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:25.597231 5149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:25.616202 5149 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43245
I20260810 18:40:25.616305 5225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43245 every 8 connection(s)
I20260810 18:40:25.617698 5149 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:25.620508 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5149
I20260810 18:40:25.620721 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:25.621346 13868 external_mini_cluster.cc:1428] Setting key e9cdeeaab597f65fccccd8805bb12c2e
I20260810 18:40:25.622176 5226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:25.635099 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:25.623262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:50087 (local address 127.0.0.1:43245)
0810 18:40:25.624119 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:25.624130 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:25.624171 (+ 41us) server_negotiation.cc:407] Connection header received
0810 18:40:25.625797 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:25.625819 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:25.626231 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:25.626577 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:25.627192 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:25.628612 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:25.630513 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:25.631182 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:25.631318 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:25.632685 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:25.632692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:25.632705 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:25.633299 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:25.633383 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:25.633412 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:25.633542 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:25.633835 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 18:40:25.634081 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":428,"threads_started":1}
I20260810 18:40:25.636420 5226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618: Bootstrap starting.
I20260810 18:40:25.638988 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:25.639744 5226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:25.640982 5226 log.cc:824] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:25.643711 5226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618: No bootstrap required, opened a new log
I20260810 18:40:25.651202 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:25.644534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:53501 (local address 127.0.0.1:43245)
0810 18:40:25.644705 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:25.644710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:25.645097 (+ 387us) server_negotiation.cc:407] Connection header received
0810 18:40:25.645243 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:25.645248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:25.645328 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:25.645448 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:25.645882 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:25.647093 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:25.648432 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:25.649167 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:25.649314 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:25.650392 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:25.650399 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:25.650404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:25.650424 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:25.650476 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:25.650512 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:25.650640 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:25.650806 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 18:40:25.650857 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:40:25.653623 5226 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e09972b3bf4fa485f106cb5d595618" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43245 } }
I20260810 18:40:25.654006 5226 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:25.654127 5226 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16e09972b3bf4fa485f106cb5d595618, State: Initialized, Role: FOLLOWER
I20260810 18:40:25.654671 5226 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e09972b3bf4fa485f106cb5d595618" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43245 } }
I20260810 18:40:25.654912 5226 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:25.655084 5226 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:25.655251 5226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:25.657533 5226 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e09972b3bf4fa485f106cb5d595618" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43245 } }
I20260810 18:40:25.658036 5226 leader_election.cc:302] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16e09972b3bf4fa485f106cb5d595618; no voters:
I20260810 18:40:25.658689 5226 leader_election.cc:288] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:25.658828 5237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:25.660203 5237 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [term 1 LEADER]: Becoming Leader. State: Replica: 16e09972b3bf4fa485f106cb5d595618, State: Running, Role: LEADER
I20260810 18:40:25.660710 5237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e09972b3bf4fa485f106cb5d595618" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43245 } }
I20260810 18:40:25.660972 5226 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:25.663414 5239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16e09972b3bf4fa485f106cb5d595618. Latest consensus state: current_term: 1 leader_uuid: "16e09972b3bf4fa485f106cb5d595618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e09972b3bf4fa485f106cb5d595618" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43245 } } }
I20260810 18:40:25.663833 5239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:25.665184 5238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16e09972b3bf4fa485f106cb5d595618" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16e09972b3bf4fa485f106cb5d595618" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43245 } } }
I20260810 18:40:25.665611 5238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:25.667011 5248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:25.672632 5248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:25.681519 5248 catalog_manager.cc:1347] Generated new cluster ID: abbea09096ea46d59692e61803e05e49
I20260810 18:40:25.681629 5248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:25.694043 5248 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:25.695297 5248 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:25.702253 5248 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16e09972b3bf4fa485f106cb5d595618: Generated new TSK 0
I20260810 18:40:25.703029 5248 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:25.710064 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5149
W20260810 18:40:25.711335 5220 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.29:50087
W20260810 18:40:25.712170 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5149: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:25.712334 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5149
W20260810 18:40:25.735235 5133 connection.cc:535] client connection to 127.0.0.1:43245 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43245): Connection reset by peer (error 104)
2026-08-10T18:40:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2070 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:25 dist-test-slave-5k54 krb5kdc[5262](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:25 dist-test-slave-5k54 krb5kdc[5262](info): set up 2 sockets
Aug 10 18:40:25 dist-test-slave-5k54 krb5kdc[5262](info): commencing operation
krb5kdc: starting...
W20260810 18:40:26.901546 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.002s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:27 dist-test-slave-5k54 krb5kdc[5262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387227, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:27.232676 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44323
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:27.580263 5277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:27.580600 5277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:27.580768 5277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:27.587960 5277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:27.588115 5277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:27.588230 5277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:27.588357 5277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:27.588446 5277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:27.598163 5277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:27.599538 5277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:27.600878 5277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:27.612809 5284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:27.612836 5282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:27.613320 5286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:27.613701 5277 server_base.cc:1034] running on GCE node
I20260810 18:40:27.614539 5277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:27.616041 5277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:27.617292 5277 hybrid_clock.cc:648] HybridClock initialized: now 1786387227617236 us; error 60 us; skew 500 ppm
I20260810 18:40:27.617667 5277 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:27 dist-test-slave-5k54 krb5kdc[5262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387227, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:27.621029 5277 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:27.622711 5277 webserver.cc:460] Webserver started at http://127.0.0.1:46857/ using document root <none> and password file <none>
I20260810 18:40:27.623381 5277 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:27.623549 5277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:27.623872 5277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:27.626850 5277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "42b8042bc29640b5842d782ef10df96a"
format_stamp: "Formatted at 2026-08-10 18:40:27 on dist-test-slave-5k54"
server_key: "5b01fee6dfa6423311aa6da1ae8db403"
server_key_iv: "04633c413f38284c27fd147229a95394"
server_key_version: "encryptionkey@0"
I20260810 18:40:27.627720 5277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "42b8042bc29640b5842d782ef10df96a"
format_stamp: "Formatted at 2026-08-10 18:40:27 on dist-test-slave-5k54"
server_key: "5b01fee6dfa6423311aa6da1ae8db403"
server_key_iv: "04633c413f38284c27fd147229a95394"
server_key_version: "encryptionkey@0"
I20260810 18:40:27.633112 5277 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260810 18:40:27.636636 5293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:27.637979 5277 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:27.638170 5277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "42b8042bc29640b5842d782ef10df96a"
format_stamp: "Formatted at 2026-08-10 18:40:27 on dist-test-slave-5k54"
server_key: "5b01fee6dfa6423311aa6da1ae8db403"
server_key_iv: "04633c413f38284c27fd147229a95394"
server_key_version: "encryptionkey@0"
I20260810 18:40:27.638370 5277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:27.644556 5277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:27.648998 5277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:27.649303 5277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:27.668421 5277 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44323
I20260810 18:40:27.668510 5354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44323 every 8 connection(s)
I20260810 18:40:27.669885 5277 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:27.673748 5356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:27.674292 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5277
I20260810 18:40:27.674489 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:27.675112 13868 external_mini_cluster.cc:1428] Setting key 712bd4ccf58c68193b80478b84a79e29
I20260810 18:40:27.682992 5359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:27.677046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:45289 (local address 127.0.0.1:44323)
0810 18:40:27.677947 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:27.677958 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:27.677997 (+ 39us) server_negotiation.cc:407] Connection header received
0810 18:40:27.679553 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:27.679576 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:27.679921 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:27.680331 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:27.681400 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:27.681406 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:27.681417 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:27.681431 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:27.681495 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:27.681514 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:27.681806 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:27.681949 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 18:40:27.682129 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":384,"threads_started":1}
I20260810 18:40:27.686792 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:27.687768 5356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a: Bootstrap starting.
I20260810 18:40:27.690838 5356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:27.692171 5356 log.cc:824] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:27.693938 5359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:27.691205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:39445 (local address 127.0.0.1:44323)
0810 18:40:27.691414 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:27.691419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:27.691950 (+ 531us) server_negotiation.cc:407] Connection header received
0810 18:40:27.692085 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:27.692090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:27.692161 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:27.692281 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:27.693297 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:27.693303 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:27.693308 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:27.693329 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:27.693375 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:27.693395 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:27.693519 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:27.693604 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 18:40:27.693671 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:40:27.695104 5356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a: No bootstrap required, opened a new log
I20260810 18:40:27.702284 5356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b8042bc29640b5842d782ef10df96a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44323 } }
I20260810 18:40:27.702662 5356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:27.702780 5356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b8042bc29640b5842d782ef10df96a, State: Initialized, Role: FOLLOWER
I20260810 18:40:27.703339 5356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b8042bc29640b5842d782ef10df96a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44323 } }
I20260810 18:40:27.703649 5356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:27.703804 5356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:27.704017 5356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:27.706334 5356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b8042bc29640b5842d782ef10df96a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44323 } }
I20260810 18:40:27.706837 5356 leader_election.cc:302] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42b8042bc29640b5842d782ef10df96a; no voters:
I20260810 18:40:27.707541 5356 leader_election.cc:288] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:27.707636 5368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:27.708410 5368 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [term 1 LEADER]: Becoming Leader. State: Replica: 42b8042bc29640b5842d782ef10df96a, State: Running, Role: LEADER
I20260810 18:40:27.708974 5368 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b8042bc29640b5842d782ef10df96a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44323 } }
I20260810 18:40:27.709699 5356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:27.711920 5371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42b8042bc29640b5842d782ef10df96a. Latest consensus state: current_term: 1 leader_uuid: "42b8042bc29640b5842d782ef10df96a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b8042bc29640b5842d782ef10df96a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44323 } } }
I20260810 18:40:27.711930 5370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42b8042bc29640b5842d782ef10df96a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42b8042bc29640b5842d782ef10df96a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44323 } } }
I20260810 18:40:27.712399 5371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:27.712390 5370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:27.713461 5377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:27.720438 5377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:27.729096 5377 catalog_manager.cc:1347] Generated new cluster ID: d2de50eb1be14d328ad8761e352598f6
I20260810 18:40:27.729223 5377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:27.755510 5377 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:27.755965 5377 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:27.764173 5377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42b8042bc29640b5842d782ef10df96a: Generated new TSK 0
I20260810 18:40:27.765026 5377 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:27.780970 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5277
W20260810 18:40:27.782387 5349 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.29:45289
W20260810 18:40:27.783133 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5277: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:27.783290 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5277
2026-08-10T18:40:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2069 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:27 dist-test-slave-5k54 krb5kdc[5391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:27 dist-test-slave-5k54 krb5kdc[5391](info): set up 2 sockets
Aug 10 18:40:27 dist-test-slave-5k54 krb5kdc[5391](info): commencing operation
krb5kdc: starting...
W20260810 18:40:29.011683 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:29 dist-test-slave-5k54 krb5kdc[5391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:29.320837 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34715
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34715
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:29.661993 5405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:29.662273 5405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:29.662482 5405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:29.669657 5405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:29.669801 5405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:29.669917 5405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:29.670018 5405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:29.670100 5405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:29.679605 5405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34715
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:29.680900 5405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:29.682204 5405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:29.694149 5410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:29.694178 5411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:29.694293 5414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:29.694865 5405 server_base.cc:1034] running on GCE node
I20260810 18:40:29.695696 5405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:29.697088 5405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:29.698314 5405 hybrid_clock.cc:648] HybridClock initialized: now 1786387229698267 us; error 60 us; skew 500 ppm
I20260810 18:40:29.698655 5405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:29 dist-test-slave-5k54 krb5kdc[5391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387229, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:29.705863 5405 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:29.707279 5405 webserver.cc:460] Webserver started at http://127.0.0.1:44315/ using document root <none> and password file <none>
I20260810 18:40:29.708011 5405 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:29.708163 5405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:29.708473 5405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:29.711546 5405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "44c2b3252d7d4ce89ff5c01ef1735872"
format_stamp: "Formatted at 2026-08-10 18:40:29 on dist-test-slave-5k54"
server_key: "6cbe51214e4e7bc39c72f0adef6750cd"
server_key_iv: "a9d28b946e5b985d0e8adb30648b296b"
server_key_version: "encryptionkey@0"
I20260810 18:40:29.712332 5405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "44c2b3252d7d4ce89ff5c01ef1735872"
format_stamp: "Formatted at 2026-08-10 18:40:29 on dist-test-slave-5k54"
server_key: "6cbe51214e4e7bc39c72f0adef6750cd"
server_key_iv: "a9d28b946e5b985d0e8adb30648b296b"
server_key_version: "encryptionkey@0"
I20260810 18:40:29.717422 5405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260810 18:40:29.720870 5422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:29.722184 5405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:40:29.722470 5405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "44c2b3252d7d4ce89ff5c01ef1735872"
format_stamp: "Formatted at 2026-08-10 18:40:29 on dist-test-slave-5k54"
server_key: "6cbe51214e4e7bc39c72f0adef6750cd"
server_key_iv: "a9d28b946e5b985d0e8adb30648b296b"
server_key_version: "encryptionkey@0"
I20260810 18:40:29.722687 5405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:29.744542 5405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:29.748597 5405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:29.748884 5405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:29.767959 5405 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34715
I20260810 18:40:29.768044 5476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34715 every 8 connection(s)
I20260810 18:40:29.769317 5405 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:29.772143 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5405
I20260810 18:40:29.772354 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:29.772821 13868 external_mini_cluster.cc:1428] Setting key 46947b0b646451e9b658da87c54d7ae7
I20260810 18:40:29.773128 5477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:29.787638 5477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872: Bootstrap starting.
Aug 10 18:40:29 dist-test-slave-5k54 krb5kdc[5391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 18:40:29.790788 5477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:29.791953 5477 log.cc:824] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:29.794762 5477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872: No bootstrap required, opened a new log
I20260810 18:40:29.796754 5480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:29.774600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:57163 (local address 127.0.0.1:34715)
0810 18:40:29.775401 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:29.775412 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:29.775504 (+ 92us) server_negotiation.cc:407] Connection header received
0810 18:40:29.777674 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:29.777693 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:29.778099 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:29.778437 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:29.780244 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:29.781561 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:29.783367 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:29.784144 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:29.784275 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:29.789221 (+ 4946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:29.789230 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:29.789243 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:29.789278 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:29.792545 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:29.793437 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:29.793444 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:29.793450 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:29.793615 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:29.794097 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:29.794101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:29.794103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:29.794572 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:29.794912 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:29.795494 (+ 582us) server_negotiation.cc:299] Negotiation successful
0810 18:40:29.795790 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":396,"threads_started":1}
I20260810 18:40:29.800626 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:29.803046 5477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34715 } }
I20260810 18:40:29.803464 5477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:29.803591 5477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c2b3252d7d4ce89ff5c01ef1735872, State: Initialized, Role: FOLLOWER
I20260810 18:40:29.804234 5477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34715 } }
I20260810 18:40:29.804466 5477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:29.804592 5477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:29.804705 5477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:29.807266 5477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34715 } }
I20260810 18:40:29.807914 5477 leader_election.cc:302] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44c2b3252d7d4ce89ff5c01ef1735872; no voters:
I20260810 18:40:29.808593 5477 leader_election.cc:288] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:29.808704 5487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:29.809450 5487 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [term 1 LEADER]: Becoming Leader. State: Replica: 44c2b3252d7d4ce89ff5c01ef1735872, State: Running, Role: LEADER
I20260810 18:40:29.810034 5487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34715 } }
I20260810 18:40:29.811928 5487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44c2b3252d7d4ce89ff5c01ef1735872. Latest consensus state: current_term: 1 leader_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34715 } } }
I20260810 18:40:29.812261 5487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:29.812762 5489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c2b3252d7d4ce89ff5c01ef1735872" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34715 } } }
I20260810 18:40:29.813658 5489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:29.817154 5477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:29.817719 5491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:29.823173 5491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:29.826288 5480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:29.805135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:50495 (local address 127.0.0.1:34715)
0810 18:40:29.805333 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:29.805339 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:29.805810 (+ 471us) server_negotiation.cc:407] Connection header received
0810 18:40:29.805946 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:29.805957 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:29.806031 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:29.806146 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:29.807636 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:29.808886 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:29.810841 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:29.811826 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:29.811989 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:29.816207 (+ 4218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:29.816215 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:29.816219 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:29.816255 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:29.820757 (+ 4502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:29.822043 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:29.822052 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:29.822058 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:29.822278 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:29.823073 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:29.823081 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:29.823087 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:29.823726 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:29.824134 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:29.825570 (+ 1436us) server_negotiation.cc:299] Negotiation successful
0810 18:40:29.825786 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 18:40:29.833416 5491 catalog_manager.cc:1347] Generated new cluster ID: 8617b80cadea4da79e8962d0a41c364c
I20260810 18:40:29.833549 5491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:29.864962 5491 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:29.866303 5491 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:29.875207 5491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44c2b3252d7d4ce89ff5c01ef1735872: Generated new TSK 0
I20260810 18:40:29.876088 5491 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:29.886299 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5405
I20260810 18:40:29.888173 5471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:29.982020 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5405
W20260810 18:40:30.003640 5389 connection.cc:535] client connection to 127.0.0.1:34715 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34715): Connection reset by peer (error 104)
2026-08-10T18:40:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2203 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:30 dist-test-slave-5k54 krb5kdc[5513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:30 dist-test-slave-5k54 krb5kdc[5513](info): set up 2 sockets
Aug 10 18:40:30 dist-test-slave-5k54 krb5kdc[5513](info): commencing operation
krb5kdc: starting...
W20260810 18:40:31.170557 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:31 dist-test-slave-5k54 krb5kdc[5513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387231, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:31.476446 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40913
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:31.815032 5527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:31.815327 5527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:31.815542 5527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:31.822777 5527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:31.822893 5527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:31.823007 5527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:31.823114 5527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:31.823182 5527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:31.833175 5527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40913
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:31.834513 5527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:31.835906 5527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:31.847962 5537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:31.847944 5535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:31.848300 5534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:31.848749 5527 server_base.cc:1034] running on GCE node
I20260810 18:40:31.849507 5527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:31.850871 5527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:31.852106 5527 hybrid_clock.cc:648] HybridClock initialized: now 1786387231852070 us; error 45 us; skew 500 ppm
I20260810 18:40:31.852474 5527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:31 dist-test-slave-5k54 krb5kdc[5513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387231, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:31.855643 5527 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:31.857196 5527 webserver.cc:460] Webserver started at http://127.0.0.1:39179/ using document root <none> and password file <none>
I20260810 18:40:31.857895 5527 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:31.858052 5527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:31.858363 5527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:31.861438 5527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "9cd75f5ba65742b080ebcaee320dd32a"
format_stamp: "Formatted at 2026-08-10 18:40:31 on dist-test-slave-5k54"
server_key: "a109a70146519c994ca5a819d9ec7c63"
server_key_iv: "98422c237f3d79c3b70c8a96356b483a"
server_key_version: "encryptionkey@0"
I20260810 18:40:31.862221 5527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "9cd75f5ba65742b080ebcaee320dd32a"
format_stamp: "Formatted at 2026-08-10 18:40:31 on dist-test-slave-5k54"
server_key: "a109a70146519c994ca5a819d9ec7c63"
server_key_iv: "98422c237f3d79c3b70c8a96356b483a"
server_key_version: "encryptionkey@0"
I20260810 18:40:31.867564 5527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260810 18:40:31.871126 5544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:31.872488 5527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 18:40:31.872668 5527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "9cd75f5ba65742b080ebcaee320dd32a"
format_stamp: "Formatted at 2026-08-10 18:40:31 on dist-test-slave-5k54"
server_key: "a109a70146519c994ca5a819d9ec7c63"
server_key_iv: "98422c237f3d79c3b70c8a96356b483a"
server_key_version: "encryptionkey@0"
I20260810 18:40:31.872915 5527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:31.896435 5527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:31.900475 5527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:31.900797 5527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:31.919824 5527 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40913
I20260810 18:40:31.919863 5601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40913 every 8 connection(s)
I20260810 18:40:31.921222 5527 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:31.924899 5602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:31.926024 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5527
I20260810 18:40:31.926229 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:31.926678 13868 external_mini_cluster.cc:1428] Setting key 8b238d2b6c7bb6b3668f8233f3c65649
I20260810 18:40:31.939683 5602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a: Bootstrap starting.
I20260810 18:40:31.941521 5605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:31.928679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:53647 (local address 127.0.0.1:40913)
0810 18:40:31.929466 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:31.929486 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:31.929536 (+ 50us) server_negotiation.cc:407] Connection header received
0810 18:40:31.931471 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:31.931499 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:31.932041 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:31.932460 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:31.932957 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:31.934816 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:31.936186 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:31.937269 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:31.937467 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:31.938707 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:31.938719 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:31.938739 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:31.939476 (+ 737us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:31.939578 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:31.939614 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:31.939783 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:31.940062 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 18:40:31.940232 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":328,"threads_started":1}
I20260810 18:40:31.943256 5602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:31.944523 5602 log.cc:824] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:31.945356 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:31.947662 5602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a: No bootstrap required, opened a new log
I20260810 18:40:31.957214 5605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:31.950612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:56813 (local address 127.0.0.1:40913)
0810 18:40:31.950805 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:31.950811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:31.951232 (+ 421us) server_negotiation.cc:407] Connection header received
0810 18:40:31.951364 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:31.951369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:31.951491 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:31.951586 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:31.952061 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:31.953202 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:31.954517 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:31.955233 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:31.955379 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:31.956470 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:31.956477 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:31.956481 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:31.956502 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:31.956559 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:31.956579 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:31.956693 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:31.956857 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 18:40:31.956908 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:40:31.957495 5602 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd75f5ba65742b080ebcaee320dd32a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40913 } }
I20260810 18:40:31.957909 5602 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:31.958043 5602 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cd75f5ba65742b080ebcaee320dd32a, State: Initialized, Role: FOLLOWER
I20260810 18:40:31.958647 5602 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd75f5ba65742b080ebcaee320dd32a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40913 } }
I20260810 18:40:31.958884 5602 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:31.959046 5602 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:31.959211 5602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:31.961601 5602 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd75f5ba65742b080ebcaee320dd32a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40913 } }
I20260810 18:40:31.962149 5602 leader_election.cc:302] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cd75f5ba65742b080ebcaee320dd32a; no voters:
I20260810 18:40:31.962724 5602 leader_election.cc:288] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:31.962867 5613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:31.963619 5613 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [term 1 LEADER]: Becoming Leader. State: Replica: 9cd75f5ba65742b080ebcaee320dd32a, State: Running, Role: LEADER
I20260810 18:40:31.964223 5613 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd75f5ba65742b080ebcaee320dd32a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40913 } }
I20260810 18:40:31.964882 5602 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:31.967476 5614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cd75f5ba65742b080ebcaee320dd32a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd75f5ba65742b080ebcaee320dd32a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40913 } } }
I20260810 18:40:31.967877 5614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:31.967558 5615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cd75f5ba65742b080ebcaee320dd32a. Latest consensus state: current_term: 1 leader_uuid: "9cd75f5ba65742b080ebcaee320dd32a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cd75f5ba65742b080ebcaee320dd32a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40913 } } }
I20260810 18:40:31.968027 5615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:31.968847 5621 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:31.975509 5621 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:31.984571 5621 catalog_manager.cc:1347] Generated new cluster ID: 92d79100ed014813b3dca0d2f60eda29
I20260810 18:40:31.984686 5621 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:32.005080 5621 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:32.006992 5621 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:32.013211 5621 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cd75f5ba65742b080ebcaee320dd32a: Generated new TSK 0
I20260810 18:40:32.014297 5621 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:32.027190 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5527
W20260810 18:40:32.028362 5597 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.29:53647
W20260810 18:40:32.029130 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5527: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:32.029295 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5527
W20260810 18:40:32.050767 5511 connection.cc:535] client connection to 127.0.0.1:40913 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40913): Connection reset by peer (error 104)
2026-08-10T18:40:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2042 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:32 dist-test-slave-5k54 krb5kdc[5636](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:32 dist-test-slave-5k54 krb5kdc[5636](info): set up 2 sockets
Aug 10 18:40:32 dist-test-slave-5k54 krb5kdc[5636](info): commencing operation
krb5kdc: starting...
W20260810 18:40:33.223930 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.007s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:33 dist-test-slave-5k54 krb5kdc[5636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387233, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 18:40:33.538504 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39399
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:33.881217 5650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:33.881505 5650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:33.881597 5650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:33.888748 5650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:33.888895 5650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:33.889005 5650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:33.889120 5650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:33.889202 5650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:33.899024 5650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39399
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:33.900342 5650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:33.901660 5650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:33.913757 5655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:33.913569 5657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:33.913806 5659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:33.914914 5650 server_base.cc:1034] running on GCE node
I20260810 18:40:33.915814 5650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:33.917140 5650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:33.918375 5650 hybrid_clock.cc:648] HybridClock initialized: now 1786387233918336 us; error 54 us; skew 500 ppm
I20260810 18:40:33.918717 5650 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:33 dist-test-slave-5k54 krb5kdc[5636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387233, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:33.921870 5650 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 18:40:33.923311 5650 webserver.cc:460] Webserver started at http://127.0.0.1:37639/ using document root <none> and password file <none>
I20260810 18:40:33.924000 5650 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:33.924151 5650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:33.924460 5650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:33.927416 5650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "e13eab81d5df4c4a93d8a3be384b3b53"
format_stamp: "Formatted at 2026-08-10 18:40:33 on dist-test-slave-5k54"
server_key: "c6febd733d09a6a69c7cab09d3e6dbd0"
server_key_iv: "1b762f51b053ab07c6f6764ea24abe4e"
server_key_version: "encryptionkey@0"
I20260810 18:40:33.928335 5650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "e13eab81d5df4c4a93d8a3be384b3b53"
format_stamp: "Formatted at 2026-08-10 18:40:33 on dist-test-slave-5k54"
server_key: "c6febd733d09a6a69c7cab09d3e6dbd0"
server_key_iv: "1b762f51b053ab07c6f6764ea24abe4e"
server_key_version: "encryptionkey@0"
I20260810 18:40:33.933439 5650 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:40:33.936858 5666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:33.938155 5650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:33.938366 5650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "e13eab81d5df4c4a93d8a3be384b3b53"
format_stamp: "Formatted at 2026-08-10 18:40:33 on dist-test-slave-5k54"
server_key: "c6febd733d09a6a69c7cab09d3e6dbd0"
server_key_iv: "1b762f51b053ab07c6f6764ea24abe4e"
server_key_version: "encryptionkey@0"
I20260810 18:40:33.938571 5650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:33.944404 5650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:33.948472 5650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:33.948786 5650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:33.968230 5650 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39399
I20260810 18:40:33.968264 5721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39399 every 8 connection(s)
I20260810 18:40:33.969708 5650 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:33.973471 5722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:33.979383 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5650
I20260810 18:40:33.979601 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:33.980172 13868 external_mini_cluster.cc:1428] Setting key ecd4975917238c8cb6568123f9ccf1fa
I20260810 18:40:33.984602 5722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53: Bootstrap starting.
I20260810 18:40:33.988183 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:33.982094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:50657 (local address 127.0.0.1:39399)
0810 18:40:33.982992 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:33.983004 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:33.983049 (+ 45us) server_negotiation.cc:407] Connection header received
0810 18:40:33.984839 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:33.984871 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:33.985208 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:33.985520 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:33.986626 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:33.986632 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:33.986644 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:33.986657 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:33.986711 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:33.986730 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:33.986936 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:33.987031 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 18:40:33.987225 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":439,"threads_started":1}
I20260810 18:40:33.988328 5722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:33.989403 5722 log.cc:824] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:33.992106 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:33.992605 5722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53: No bootstrap required, opened a new log
I20260810 18:40:33.999163 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:33.996588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.29:54451 (local address 127.0.0.1:39399)
0810 18:40:33.996770 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:33.996783 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:33.997194 (+ 411us) server_negotiation.cc:407] Connection header received
0810 18:40:33.997391 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:33.997401 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:33.997454 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:33.997567 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:33.998489 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:33.998494 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:33.998499 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:33.998516 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:33.998564 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:33.998583 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:33.998724 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:33.998821 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 18:40:33.998888 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:40:34.001231 5722 raft_consensus.cc:348] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39399 } }
I20260810 18:40:34.001616 5722 raft_consensus.cc:374] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:34.001732 5722 raft_consensus.cc:729] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13eab81d5df4c4a93d8a3be384b3b53, State: Initialized, Role: FOLLOWER
I20260810 18:40:34.002307 5722 consensus_queue.cc:260] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39399 } }
I20260810 18:40:34.002559 5722 raft_consensus.cc:388] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:34.002722 5722 raft_consensus.cc:482] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:34.002902 5722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:34.005342 5722 raft_consensus.cc:504] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39399 } }
I20260810 18:40:34.005843 5722 leader_election.cc:302] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e13eab81d5df4c4a93d8a3be384b3b53; no voters:
I20260810 18:40:34.006536 5722 leader_election.cc:288] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:34.006685 5733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:34.007726 5733 raft_consensus.cc:686] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [term 1 LEADER]: Becoming Leader. State: Replica: e13eab81d5df4c4a93d8a3be384b3b53, State: Running, Role: LEADER
I20260810 18:40:34.008319 5733 consensus_queue.cc:237] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39399 } }
I20260810 18:40:34.009033 5722 sys_catalog.cc:564] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:34.011515 5735 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e13eab81d5df4c4a93d8a3be384b3b53. Latest consensus state: current_term: 1 leader_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39399 } } }
I20260810 18:40:34.011911 5735 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:34.011641 5734 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13eab81d5df4c4a93d8a3be384b3b53" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39399 } } }
I20260810 18:40:34.012032 5734 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:34.014777 5739 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:34.020033 5739 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:34.029213 5739 catalog_manager.cc:1347] Generated new cluster ID: 9baf3f1e174246dc9839a1ef923dfa82
I20260810 18:40:34.029325 5739 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:34.041270 5739 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:34.041733 5739 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:34.050314 5739 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e13eab81d5df4c4a93d8a3be384b3b53: Generated new TSK 0
I20260810 18:40:34.051283 5739 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:34.060456 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5650
W20260810 18:40:34.061554 5717 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.29:50657
W20260810 18:40:34.062266 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5650: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:34.062433 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5650
2026-08-10T18:40:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2032 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:34 dist-test-slave-5k54 krb5kdc[5757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:34 dist-test-slave-5k54 krb5kdc[5757](info): set up 2 sockets
Aug 10 18:40:34 dist-test-slave-5k54 krb5kdc[5757](info): commencing operation
krb5kdc: starting...
W20260810 18:40:35.276674 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:35 dist-test-slave-5k54 krb5kdc[5757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:35.595777 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46621
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:36801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:46621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:35.937950 5772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:35.938230 5772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:35.938374 5772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:35.945919 5772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:35.946062 5772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:35.946173 5772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:35.946282 5772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:35.946367 5772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:35.956166 5772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:36801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:46621
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:46621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:35.957484 5772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:35.958837 5772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:35.970901 5777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:35.970922 5778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:35.970939 5780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:35.972236 5772 server_base.cc:1034] running on GCE node
I20260810 18:40:35.973003 5772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:35.974459 5772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:35.975687 5772 hybrid_clock.cc:648] HybridClock initialized: now 1786387235975628 us; error 56 us; skew 500 ppm
I20260810 18:40:35.976049 5772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:35 dist-test-slave-5k54 krb5kdc[5757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387235, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:35.979175 5772 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:35.980716 5772 webserver.cc:460] Webserver started at http://127.13.139.62:37927/ using document root <none> and password file <none>
I20260810 18:40:35.981411 5772 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:35.981566 5772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:35.981868 5772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:35.984992 5772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "e7a9daeac76d44d29d374fd44cf2bbe4"
format_stamp: "Formatted at 2026-08-10 18:40:35 on dist-test-slave-5k54"
server_key: "83668c21bd5eec0e57fa63ecb890f74b"
server_key_iv: "2e6f73dfe2cb5c8fabcea6da74b2a676"
server_key_version: "encryptionkey@0"
I20260810 18:40:35.985800 5772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "e7a9daeac76d44d29d374fd44cf2bbe4"
format_stamp: "Formatted at 2026-08-10 18:40:35 on dist-test-slave-5k54"
server_key: "83668c21bd5eec0e57fa63ecb890f74b"
server_key_iv: "2e6f73dfe2cb5c8fabcea6da74b2a676"
server_key_version: "encryptionkey@0"
I20260810 18:40:35.990988 5772 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:40:35.994393 5787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:35.995754 5772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:40:35.995960 5772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "e7a9daeac76d44d29d374fd44cf2bbe4"
format_stamp: "Formatted at 2026-08-10 18:40:35 on dist-test-slave-5k54"
server_key: "83668c21bd5eec0e57fa63ecb890f74b"
server_key_iv: "2e6f73dfe2cb5c8fabcea6da74b2a676"
server_key_version: "encryptionkey@0"
I20260810 18:40:35.996158 5772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:36.015163 5772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:36.019536 5772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:36.019922 5772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:36.038787 5772 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:46621
I20260810 18:40:36.038813 5844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:46621 every 8 connection(s)
I20260810 18:40:36.040271 5772 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:36.044243 5845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:36.046427 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5772
I20260810 18:40:36.046639 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:36.047099 13868 external_mini_cluster.cc:1428] Setting key a94ca60b9774c6247dd049c692badd61
I20260810 18:40:36.056384 5845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4: Bootstrap starting.
I20260810 18:40:36.060396 5845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:36.061830 5845 log.cc:824] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4: Log is configured to *not* fsync() on all Append() calls
Aug 10 18:40:36 dist-test-slave-5k54 krb5kdc[5757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:36.065184 5845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4: No bootstrap required, opened a new log
I20260810 18:40:36.072091 5848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:36.049063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40721 (local address 127.13.139.62:46621)
0810 18:40:36.049919 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:36.049930 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:36.049969 (+ 39us) server_negotiation.cc:407] Connection header received
0810 18:40:36.051679 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:36.051702 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:36.052111 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:36.052434 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:36.054351 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:36.055705 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:36.057431 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:36.058109 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:36.058241 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:36.063864 (+ 5623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:36.063873 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:36.063889 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:36.063927 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:36.067223 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:36.068169 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:36.068178 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:36.068185 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:36.068367 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:36.068889 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:36.068898 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:36.068901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:36.069658 (+ 757us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:36.070065 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:36.070565 (+ 500us) server_negotiation.cc:299] Negotiation successful
0810 18:40:36.070974 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":398,"threads_started":1}
I20260810 18:40:36.073455 5845 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46621 } }
I20260810 18:40:36.073838 5845 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:36.073969 5845 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a9daeac76d44d29d374fd44cf2bbe4, State: Initialized, Role: FOLLOWER
I20260810 18:40:36.074653 5845 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46621 } }
I20260810 18:40:36.074934 5845 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:36.075105 5845 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:36.075300 5845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:36.076294 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:36.077773 5845 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46621 } }
I20260810 18:40:36.078285 5845 leader_election.cc:302] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7a9daeac76d44d29d374fd44cf2bbe4; no voters:
I20260810 18:40:36.078935 5845 leader_election.cc:288] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:36.079066 5851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:36.081565 5845 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:36.083729 5851 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [term 1 LEADER]: Becoming Leader. State: Replica: e7a9daeac76d44d29d374fd44cf2bbe4, State: Running, Role: LEADER
I20260810 18:40:36.084529 5851 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46621 } }
I20260810 18:40:36.089579 5853 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46621 } } }
I20260810 18:40:36.090060 5853 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:36.090683 5854 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7a9daeac76d44d29d374fd44cf2bbe4. Latest consensus state: current_term: 1 leader_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7a9daeac76d44d29d374fd44cf2bbe4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 46621 } } }
I20260810 18:40:36.091060 5854 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:36.093199 5862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:36.104894 5862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:36.114792 5848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:36.088560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56429 (local address 127.13.139.62:46621)
0810 18:40:36.088825 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:36.088832 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:36.093424 (+ 4592us) server_negotiation.cc:407] Connection header received
0810 18:40:36.093693 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:36.093699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:36.093780 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:36.093852 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:36.096143 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:36.097406 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:36.099327 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:36.100037 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:36.100252 (+ 215us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:36.103703 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:36.103717 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:36.103725 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:36.103783 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:36.108979 (+ 5196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:36.110393 (+ 1414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:36.110403 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:36.110406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:36.110612 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:36.111392 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:36.111399 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:36.111402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:36.111968 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:36.113730 (+ 1762us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:36.113969 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 18:40:36.114222 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":131}
I20260810 18:40:36.122944 5862 catalog_manager.cc:1347] Generated new cluster ID: 006f87b47a3847c69f0112371c6b5392
I20260810 18:40:36.123262 5862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:36.138831 5862 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:36.140241 5862 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:36.150418 5862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7a9daeac76d44d29d374fd44cf2bbe4: Generated new TSK 0
I20260810 18:40:36.151279 5862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:36.164747 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5772
I20260810 18:40:36.166441 5840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:36.291630 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5772
W20260810 18:40:36.319145 5755 connection.cc:535] client connection to 127.13.139.62:46621 recv error: Network error: failed to read from TLS socket (remote: 127.13.139.62:46621): Connection reset by peer (error 104)
2026-08-10T18:40:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2235 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:36 dist-test-slave-5k54 krb5kdc[5877](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:36 dist-test-slave-5k54 krb5kdc[5877](info): set up 2 sockets
Aug 10 18:40:36 dist-test-slave-5k54 krb5kdc[5877](info): commencing operation
krb5kdc: starting...
W20260810 18:40:37.486548 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:37 dist-test-slave-5k54 krb5kdc[5877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:37.807386 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37045
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:44427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:37045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:38.149571 5891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:38.149858 5891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:38.150048 5891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:38.157244 5891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:38.157378 5891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:38.157469 5891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:38.157580 5891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:38.157667 5891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:38.167500 5891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:44427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:37045
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:38.168812 5891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:38.170152 5891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:38.181985 5897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:38.182024 5899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:38.182066 5901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:38.182811 5891 server_base.cc:1034] running on GCE node
I20260810 18:40:38.183646 5891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:38.185024 5891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:38.186262 5891 hybrid_clock.cc:648] HybridClock initialized: now 1786387238186234 us; error 50 us; skew 500 ppm
I20260810 18:40:38.186631 5891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:38 dist-test-slave-5k54 krb5kdc[5877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387238, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:38.189992 5891 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:38.191617 5891 webserver.cc:460] Webserver started at http://127.13.139.62:42727/ using document root <none> and password file <none>
I20260810 18:40:38.192320 5891 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:38.192471 5891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:38.192786 5891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:38.195875 5891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "a80a688a7301477a87d59dc1794d9dd4"
format_stamp: "Formatted at 2026-08-10 18:40:38 on dist-test-slave-5k54"
server_key: "3b63154d6281befc0463b3362968960e"
server_key_iv: "96def2ac592af64856fa6f708dc0dfbb"
server_key_version: "encryptionkey@0"
I20260810 18:40:38.196671 5891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "a80a688a7301477a87d59dc1794d9dd4"
format_stamp: "Formatted at 2026-08-10 18:40:38 on dist-test-slave-5k54"
server_key: "3b63154d6281befc0463b3362968960e"
server_key_iv: "96def2ac592af64856fa6f708dc0dfbb"
server_key_version: "encryptionkey@0"
I20260810 18:40:38.201865 5891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:40:38.205440 5909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:38.206758 5891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:40:38.206954 5891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "a80a688a7301477a87d59dc1794d9dd4"
format_stamp: "Formatted at 2026-08-10 18:40:38 on dist-test-slave-5k54"
server_key: "3b63154d6281befc0463b3362968960e"
server_key_iv: "96def2ac592af64856fa6f708dc0dfbb"
server_key_version: "encryptionkey@0"
I20260810 18:40:38.207162 5891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:38.222574 5891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:38.227344 5891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:38.227679 5891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:38.247977 5891 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:37045
I20260810 18:40:38.248013 5964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:37045 every 8 connection(s)
I20260810 18:40:38.249445 5891 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:38.253412 5965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:38.259517 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 5891
I20260810 18:40:38.259730 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:38.260310 13868 external_mini_cluster.cc:1428] Setting key 11493f6748ab94d62e49991c0342bc24
I20260810 18:40:38.264829 5965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4: Bootstrap starting.
I20260810 18:40:38.268532 5965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:38.269845 5965 log.cc:824] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:38.273458 5965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4: No bootstrap required, opened a new log
I20260810 18:40:38.274677 5968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:38.262250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55751 (local address 127.13.139.62:37045)
0810 18:40:38.263109 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:38.263121 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:38.263163 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:40:38.264924 (+ 1761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:38.264956 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:38.265351 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:38.265664 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:38.266310 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:38.267693 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:38.269603 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:38.270421 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:38.270628 (+ 207us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:38.271838 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:38.271849 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:38.271867 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:38.272614 (+ 747us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:38.272710 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:38.272742 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:38.272940 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:38.273195 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 18:40:38.273359 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":421,"threads_started":1}
I20260810 18:40:38.278872 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:38.282199 5965 raft_consensus.cc:348] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a80a688a7301477a87d59dc1794d9dd4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37045 } }
I20260810 18:40:38.282550 5965 raft_consensus.cc:374] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:38.282646 5965 raft_consensus.cc:729] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a80a688a7301477a87d59dc1794d9dd4, State: Initialized, Role: FOLLOWER
I20260810 18:40:38.283293 5965 consensus_queue.cc:260] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a80a688a7301477a87d59dc1794d9dd4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37045 } }
I20260810 18:40:38.283659 5965 raft_consensus.cc:388] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:38.283831 5965 raft_consensus.cc:482] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:38.284029 5965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:38.286386 5965 raft_consensus.cc:504] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a80a688a7301477a87d59dc1794d9dd4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37045 } }
I20260810 18:40:38.286868 5965 leader_election.cc:302] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a80a688a7301477a87d59dc1794d9dd4; no voters:
I20260810 18:40:38.287650 5965 leader_election.cc:288] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:38.287765 5975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:38.289289 5975 raft_consensus.cc:686] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [term 1 LEADER]: Becoming Leader. State: Replica: a80a688a7301477a87d59dc1794d9dd4, State: Running, Role: LEADER
I20260810 18:40:38.290244 5975 consensus_queue.cc:237] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a80a688a7301477a87d59dc1794d9dd4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37045 } }
I20260810 18:40:38.290454 5965 sys_catalog.cc:564] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:38.290836 5968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:38.283601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56093 (local address 127.13.139.62:37045)
0810 18:40:38.283828 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:38.283835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:38.284162 (+ 327us) server_negotiation.cc:407] Connection header received
0810 18:40:38.284373 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:38.284379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:38.284448 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:38.284562 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:38.285088 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:38.285857 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:38.287295 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:38.288119 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:38.288275 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:38.289791 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:38.289796 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:38.289799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:38.289815 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:38.289851 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:38.289865 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:38.289943 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:38.290448 (+ 505us) server_negotiation.cc:299] Negotiation successful
0810 18:40:38.290501 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 18:40:38.294121 5976 sys_catalog.cc:455] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a80a688a7301477a87d59dc1794d9dd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a80a688a7301477a87d59dc1794d9dd4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37045 } } }
I20260810 18:40:38.294528 5976 sys_catalog.cc:458] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:38.295035 5977 sys_catalog.cc:455] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a80a688a7301477a87d59dc1794d9dd4. Latest consensus state: current_term: 1 leader_uuid: "a80a688a7301477a87d59dc1794d9dd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a80a688a7301477a87d59dc1794d9dd4" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37045 } } }
I20260810 18:40:38.295341 5977 sys_catalog.cc:458] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:38.300823 5984 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:38.305713 5984 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:38.313897 5984 catalog_manager.cc:1347] Generated new cluster ID: 2a54c17dfc8a4576b1733f6fd6b1e1db
I20260810 18:40:38.314039 5984 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:38.337546 5984 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:38.339495 5984 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:38.350536 5984 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a80a688a7301477a87d59dc1794d9dd4: Generated new TSK 0
I20260810 18:40:38.351619 5984 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:38.363349 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5891
W20260810 18:40:38.364573 5960 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55751
W20260810 18:40:38.365351 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 5891: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:38.365510 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 5891
W20260810 18:40:38.388258 5875 connection.cc:535] client connection to 127.13.139.62:37045 recv error: Network error: failed to read from TLS socket (remote: 127.13.139.62:37045): Connection reset by peer (error 104)
2026-08-10T18:40:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2069 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:38 dist-test-slave-5k54 krb5kdc[5998](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:38 dist-test-slave-5k54 krb5kdc[5998](info): set up 2 sockets
Aug 10 18:40:38 dist-test-slave-5k54 krb5kdc[5998](info): commencing operation
krb5kdc: starting...
W20260810 18:40:39.574877 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.006s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:39 dist-test-slave-5k54 krb5kdc[5998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:39.900951 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:39883
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:39883
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:40.245822 6012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:40.246112 6012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:40.246205 6012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:40.253630 6012 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:40.253744 6012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:40.253791 6012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:40.253845 6012 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:40.253885 6012 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:40.263854 6012 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:39883
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:39883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:40.265110 6012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:40.266366 6012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:40.278014 6017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:40.278052 6018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:40.278014 6020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:40.279511 6012 server_base.cc:1034] running on GCE node
I20260810 18:40:40.280287 6012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:40.281665 6012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:40.282868 6012 hybrid_clock.cc:648] HybridClock initialized: now 1786387240282824 us; error 44 us; skew 500 ppm
I20260810 18:40:40.283224 6012 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:40 dist-test-slave-5k54 krb5kdc[5998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387240, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:40.291733 6012 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:40.293315 6012 webserver.cc:460] Webserver started at http://127.13.139.62:45321/ using document root <none> and password file <none>
I20260810 18:40:40.294018 6012 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:40.294152 6012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:40.294466 6012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:40.297502 6012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "8657cd969425425ea2dfd04d44d6e3f2"
format_stamp: "Formatted at 2026-08-10 18:40:40 on dist-test-slave-5k54"
server_key: "19ecbe586f5341e1b6aaa5d2e49b6388"
server_key_iv: "8251f32b27ecc129bd6d23db8639dad1"
server_key_version: "encryptionkey@0"
I20260810 18:40:40.298234 6012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "8657cd969425425ea2dfd04d44d6e3f2"
format_stamp: "Formatted at 2026-08-10 18:40:40 on dist-test-slave-5k54"
server_key: "19ecbe586f5341e1b6aaa5d2e49b6388"
server_key_iv: "8251f32b27ecc129bd6d23db8639dad1"
server_key_version: "encryptionkey@0"
I20260810 18:40:40.303385 6012 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260810 18:40:40.306821 6027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:40.308485 6012 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:40:40.308671 6012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "8657cd969425425ea2dfd04d44d6e3f2"
format_stamp: "Formatted at 2026-08-10 18:40:40 on dist-test-slave-5k54"
server_key: "19ecbe586f5341e1b6aaa5d2e49b6388"
server_key_iv: "8251f32b27ecc129bd6d23db8639dad1"
server_key_version: "encryptionkey@0"
I20260810 18:40:40.308866 6012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:40.314579 6012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:40.319149 6012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:40.319485 6012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:40.338066 6012 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:39883
I20260810 18:40:40.338097 6084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:39883 every 8 connection(s)
I20260810 18:40:40.339466 6012 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:40.343116 6085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:40.344893 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6012
I20260810 18:40:40.345129 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:40.345696 13868 external_mini_cluster.cc:1428] Setting key 33c6947245796bcb9c808ff8ceb149a2
I20260810 18:40:40.353336 6088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:40.347591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56245 (local address 127.13.139.62:39883)
0810 18:40:40.348369 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:40.348381 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:40.348427 (+ 46us) server_negotiation.cc:407] Connection header received
0810 18:40:40.349993 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:40.350013 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:40.350348 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:40.350727 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:40.351815 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:40.351821 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:40.351832 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:40.351845 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:40.351895 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:40.351917 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:40.352144 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:40.352278 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 18:40:40.352457 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":335,"threads_started":1}
I20260810 18:40:40.356772 6085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2: Bootstrap starting.
I20260810 18:40:40.356967 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:40.359913 6085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:40.360962 6085 log.cc:824] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:40.364235 6088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:40.361600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46053 (local address 127.13.139.62:39883)
0810 18:40:40.361837 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:40.361845 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:40.362251 (+ 406us) server_negotiation.cc:407] Connection header received
0810 18:40:40.362538 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:40.362543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:40.362599 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:40.362715 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:40.363618 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:40.363624 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:40.363628 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:40.363661 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:40.363703 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:40.363723 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:40.363846 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:40.363916 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 18:40:40.363972 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 18:40:40.364410 6085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2: No bootstrap required, opened a new log
I20260810 18:40:40.371905 6085 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657cd969425425ea2dfd04d44d6e3f2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39883 } }
I20260810 18:40:40.372277 6085 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:40.372428 6085 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8657cd969425425ea2dfd04d44d6e3f2, State: Initialized, Role: FOLLOWER
I20260810 18:40:40.373081 6085 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657cd969425425ea2dfd04d44d6e3f2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39883 } }
I20260810 18:40:40.373288 6085 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:40.373399 6085 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:40.373513 6085 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:40.375715 6085 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657cd969425425ea2dfd04d44d6e3f2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39883 } }
I20260810 18:40:40.376199 6085 leader_election.cc:302] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8657cd969425425ea2dfd04d44d6e3f2; no voters:
I20260810 18:40:40.376770 6085 leader_election.cc:288] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:40.376924 6096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:40.378158 6096 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [term 1 LEADER]: Becoming Leader. State: Replica: 8657cd969425425ea2dfd04d44d6e3f2, State: Running, Role: LEADER
I20260810 18:40:40.378682 6096 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657cd969425425ea2dfd04d44d6e3f2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39883 } }
I20260810 18:40:40.378890 6085 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:40.381383 6097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8657cd969425425ea2dfd04d44d6e3f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657cd969425425ea2dfd04d44d6e3f2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39883 } } }
I20260810 18:40:40.381723 6097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:40.382632 6103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:40.382474 6098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8657cd969425425ea2dfd04d44d6e3f2. Latest consensus state: current_term: 1 leader_uuid: "8657cd969425425ea2dfd04d44d6e3f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8657cd969425425ea2dfd04d44d6e3f2" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 39883 } } }
I20260810 18:40:40.382807 6098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:40.391484 6103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:40.399827 6103 catalog_manager.cc:1347] Generated new cluster ID: 2a1b21c85dc74f869286b694cdfa9f34
I20260810 18:40:40.399942 6103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:40.421772 6103 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:40.422210 6103 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:40.433600 6103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8657cd969425425ea2dfd04d44d6e3f2: Generated new TSK 0
I20260810 18:40:40.434414 6103 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:40.452059 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6012
W20260810 18:40:40.453130 6080 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56245
W20260810 18:40:40.453840 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6012: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:40.453995 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6012
2026-08-10T18:40:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2083 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:40 dist-test-slave-5k54 krb5kdc[6120](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:40 dist-test-slave-5k54 krb5kdc[6120](info): set up 2 sockets
Aug 10 18:40:40 dist-test-slave-5k54 krb5kdc[6120](info): commencing operation
krb5kdc: starting...
W20260810 18:40:41.636540 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.004s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:41 dist-test-slave-5k54 krb5kdc[6120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:41.960873 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:41155
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:41821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:41155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:42.298774 6135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:42.299049 6135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:42.299140 6135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:42.306202 6135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:42.306303 6135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:42.306349 6135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:42.306403 6135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:42.306447 6135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:42.316103 6135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:41821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:41155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:41155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:42.317293 6135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:42.318521 6135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:42.330194 6143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:42.330255 6141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:42.330221 6140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:42.331705 6135 server_base.cc:1034] running on GCE node
I20260810 18:40:42.332698 6135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:42.334067 6135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:42.335310 6135 hybrid_clock.cc:648] HybridClock initialized: now 1786387242335262 us; error 57 us; skew 500 ppm
I20260810 18:40:42.335719 6135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:42 dist-test-slave-5k54 krb5kdc[6120](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387242, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:42.338838 6135 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:42.340299 6135 webserver.cc:460] Webserver started at http://127.13.139.62:44323/ using document root <none> and password file <none>
I20260810 18:40:42.340951 6135 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:42.341077 6135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:42.341382 6135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:42.344352 6135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "ee7389fd999f4b3a8e77b68551b9edf7"
format_stamp: "Formatted at 2026-08-10 18:40:42 on dist-test-slave-5k54"
server_key: "de7c7f534b0525eadd9be95f101abbcd"
server_key_iv: "c19c22b1a770550e294e7981c09b78d6"
server_key_version: "encryptionkey@0"
I20260810 18:40:42.345108 6135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "ee7389fd999f4b3a8e77b68551b9edf7"
format_stamp: "Formatted at 2026-08-10 18:40:42 on dist-test-slave-5k54"
server_key: "de7c7f534b0525eadd9be95f101abbcd"
server_key_iv: "c19c22b1a770550e294e7981c09b78d6"
server_key_version: "encryptionkey@0"
I20260810 18:40:42.350272 6135 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 18:40:42.353847 6151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:42.355178 6135 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:40:42.355325 6135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "ee7389fd999f4b3a8e77b68551b9edf7"
format_stamp: "Formatted at 2026-08-10 18:40:42 on dist-test-slave-5k54"
server_key: "de7c7f534b0525eadd9be95f101abbcd"
server_key_iv: "c19c22b1a770550e294e7981c09b78d6"
server_key_version: "encryptionkey@0"
I20260810 18:40:42.355556 6135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:42.374920 6135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:42.378710 6135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:42.378953 6135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:42.397630 6135 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:41155
I20260810 18:40:42.397663 6208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:41155 every 8 connection(s)
I20260810 18:40:42.399024 6135 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:42.402448 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6135
I20260810 18:40:42.402667 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:42.402829 6209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:42.403196 13868 external_mini_cluster.cc:1428] Setting key f4565579612f0fc0f7b1c3753a3091e7
I20260810 18:40:42.417403 6209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7: Bootstrap starting.
Aug 10 18:40:42 dist-test-slave-5k54 krb5kdc[6120](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:42.421182 6209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:42.422534 6209 log.cc:824] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:42.426030 6209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7: No bootstrap required, opened a new log
I20260810 18:40:42.427826 6212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:42.405033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48301 (local address 127.13.139.62:41155)
0810 18:40:42.405859 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:42.405870 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:42.405915 (+ 45us) server_negotiation.cc:407] Connection header received
0810 18:40:42.407541 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:42.407563 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:42.407949 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:42.408257 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:42.410012 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:42.411277 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:42.413191 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:42.413857 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:42.413998 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:42.418917 (+ 4919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:42.418928 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:42.418946 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:42.418994 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:42.422966 (+ 3972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:42.423856 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:42.423862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:42.423867 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:42.424071 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:42.424444 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:42.424449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:42.424452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:42.425167 (+ 715us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:42.425482 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:42.426056 (+ 574us) server_negotiation.cc:299] Negotiation successful
0810 18:40:42.426499 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":369,"threads_started":1}
I20260810 18:40:42.431730 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:42.436784 6209 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41155 } }
I20260810 18:40:42.437224 6209 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:42.437366 6209 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee7389fd999f4b3a8e77b68551b9edf7, State: Initialized, Role: FOLLOWER
I20260810 18:40:42.437999 6209 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41155 } }
I20260810 18:40:42.438261 6209 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:42.438423 6209 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:42.438611 6209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:42.440946 6209 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41155 } }
I20260810 18:40:42.441450 6209 leader_election.cc:302] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee7389fd999f4b3a8e77b68551b9edf7; no voters:
I20260810 18:40:42.442090 6209 leader_election.cc:288] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:42.442207 6219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:42.443998 6219 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [term 1 LEADER]: Becoming Leader. State: Replica: ee7389fd999f4b3a8e77b68551b9edf7, State: Running, Role: LEADER
I20260810 18:40:42.444561 6209 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:42.444567 6219 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41155 } }
I20260810 18:40:42.452564 6220 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41155 } } }
I20260810 18:40:42.452972 6220 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:42.453485 6221 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee7389fd999f4b3a8e77b68551b9edf7. Latest consensus state: current_term: 1 leader_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7389fd999f4b3a8e77b68551b9edf7" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 41155 } } }
I20260810 18:40:42.453799 6221 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:42.455858 6212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:42.437020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56573 (local address 127.13.139.62:41155)
0810 18:40:42.437229 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:42.437237 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:42.437764 (+ 527us) server_negotiation.cc:407] Connection header received
0810 18:40:42.437979 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:42.437994 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:42.438058 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:42.438185 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:42.439684 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:42.440397 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:42.441724 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:42.442556 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:42.443319 (+ 763us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:42.445944 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:42.445954 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:42.445961 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:42.446010 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:42.450821 (+ 4811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:42.451883 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:42.451889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:42.451892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:42.452043 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:42.452613 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:42.452619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:42.452624 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:42.453189 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:42.454782 (+ 1593us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:42.454971 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 18:40:42.455293 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 18:40:42.461056 6224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:42.466019 6224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:42.474331 6224 catalog_manager.cc:1347] Generated new cluster ID: 8438da2d40ac4173a52c21b20bcdbc04
I20260810 18:40:42.474469 6224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:42.492781 6224 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:42.494081 6224 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:42.501603 6224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee7389fd999f4b3a8e77b68551b9edf7: Generated new TSK 0
I20260810 18:40:42.502429 6224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:42.509256 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6135
I20260810 18:40:42.510365 6204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:42.600685 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6135
2026-08-10T18:40:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2149 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:42 dist-test-slave-5k54 krb5kdc[6246](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:42 dist-test-slave-5k54 krb5kdc[6246](info): set up 2 sockets
Aug 10 18:40:42 dist-test-slave-5k54 krb5kdc[6246](info): commencing operation
krb5kdc: starting...
W20260810 18:40:43.786345 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:43 dist-test-slave-5k54 krb5kdc[6246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:44.118371 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37539
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:37433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:37539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:44.457129 6261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:44.457436 6261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:44.457625 6261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:44.465095 6261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:44.465214 6261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:44.465330 6261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:44.465436 6261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:44.465515 6261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:44.475345 6261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:37433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:37539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:37539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:44.476687 6261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:44.477969 6261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:44.489800 6266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:44.489760 6267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:44.489776 6269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:44.490988 6261 server_base.cc:1034] running on GCE node
I20260810 18:40:44.491882 6261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:44.493218 6261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:44.494421 6261 hybrid_clock.cc:648] HybridClock initialized: now 1786387244494354 us; error 63 us; skew 500 ppm
I20260810 18:40:44.494796 6261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:44 dist-test-slave-5k54 krb5kdc[6246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387244, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:44.498061 6261 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:44.499621 6261 webserver.cc:460] Webserver started at http://127.13.139.62:33075/ using document root <none> and password file <none>
I20260810 18:40:44.500298 6261 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:44.500450 6261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:44.500756 6261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:44.503890 6261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "e0344aed170544078fd11c92b87a05c3"
format_stamp: "Formatted at 2026-08-10 18:40:44 on dist-test-slave-5k54"
server_key: "3ec535c949c0689ca2081b3faeb99a5f"
server_key_iv: "e13de93bc4ebb0a0904561106b495faf"
server_key_version: "encryptionkey@0"
I20260810 18:40:44.504666 6261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "e0344aed170544078fd11c92b87a05c3"
format_stamp: "Formatted at 2026-08-10 18:40:44 on dist-test-slave-5k54"
server_key: "3ec535c949c0689ca2081b3faeb99a5f"
server_key_iv: "e13de93bc4ebb0a0904561106b495faf"
server_key_version: "encryptionkey@0"
I20260810 18:40:44.509922 6261 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 18:40:44.513453 6277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:44.514802 6261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 18:40:44.514993 6261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "e0344aed170544078fd11c92b87a05c3"
format_stamp: "Formatted at 2026-08-10 18:40:44 on dist-test-slave-5k54"
server_key: "3ec535c949c0689ca2081b3faeb99a5f"
server_key_iv: "e13de93bc4ebb0a0904561106b495faf"
server_key_version: "encryptionkey@0"
I20260810 18:40:44.515202 6261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:44.539603 6261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:44.544059 6261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:44.544373 6261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:44.563496 6261 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:37539
I20260810 18:40:44.563549 6334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:37539 every 8 connection(s)
I20260810 18:40:44.564888 6261 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:44.568646 6335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:44.569942 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6261
I20260810 18:40:44.570154 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:44.570590 13868 external_mini_cluster.cc:1428] Setting key 14ef1fe363ea42b6882231158493b075
I20260810 18:40:44.582471 6335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3: Bootstrap starting.
I20260810 18:40:44.583987 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:44.572374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43509 (local address 127.13.139.62:37539)
0810 18:40:44.573178 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:44.573189 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:44.573232 (+ 43us) server_negotiation.cc:407] Connection header received
0810 18:40:44.574815 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:44.574839 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:44.575228 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:44.575616 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:44.576225 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:44.577506 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:44.579524 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:44.580234 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:44.580358 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:44.581637 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:44.581644 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:44.581658 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:44.582219 (+ 561us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:44.582294 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:44.582320 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:44.582433 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:44.582712 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 18:40:44.582997 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":380,"threads_started":1}
I20260810 18:40:44.585783 6335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:44.586967 6335 log.cc:824] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:44.587666 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:44.589638 6335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3: No bootstrap required, opened a new log
I20260810 18:40:44.598721 6338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:44.592089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40239 (local address 127.13.139.62:37539)
0810 18:40:44.592276 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:44.592282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:44.592846 (+ 564us) server_negotiation.cc:407] Connection header received
0810 18:40:44.593006 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:44.593009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:44.593072 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:44.593148 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:44.593763 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:44.594446 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:44.596308 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:44.596765 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:44.596861 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:44.598023 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:44.598027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:44.598030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:44.598047 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:44.598084 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:44.598099 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:44.598174 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:44.598319 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 18:40:44.598385 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:40:44.599520 6335 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0344aed170544078fd11c92b87a05c3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37539 } }
I20260810 18:40:44.600003 6335 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:44.600119 6335 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0344aed170544078fd11c92b87a05c3, State: Initialized, Role: FOLLOWER
I20260810 18:40:44.600710 6335 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0344aed170544078fd11c92b87a05c3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37539 } }
I20260810 18:40:44.600966 6335 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:44.601116 6335 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:44.601302 6335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:44.603502 6335 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0344aed170544078fd11c92b87a05c3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37539 } }
I20260810 18:40:44.604099 6335 leader_election.cc:302] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0344aed170544078fd11c92b87a05c3; no voters:
I20260810 18:40:44.604727 6335 leader_election.cc:288] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:44.604869 6346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:44.605583 6346 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [term 1 LEADER]: Becoming Leader. State: Replica: e0344aed170544078fd11c92b87a05c3, State: Running, Role: LEADER
I20260810 18:40:44.606128 6346 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0344aed170544078fd11c92b87a05c3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37539 } }
I20260810 18:40:44.606904 6335 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:44.609267 6347 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0344aed170544078fd11c92b87a05c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0344aed170544078fd11c92b87a05c3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37539 } } }
I20260810 18:40:44.609656 6347 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:44.610387 6348 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0344aed170544078fd11c92b87a05c3. Latest consensus state: current_term: 1 leader_uuid: "e0344aed170544078fd11c92b87a05c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0344aed170544078fd11c92b87a05c3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 37539 } } }
I20260810 18:40:44.610807 6348 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:44.611680 6351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:44.618275 6351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:44.630366 6351 catalog_manager.cc:1347] Generated new cluster ID: 8de1c1f2a76145ee90a075b468583a1b
I20260810 18:40:44.630484 6351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:44.659089 6351 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:44.660490 6351 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:44.670708 6351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0344aed170544078fd11c92b87a05c3: Generated new TSK 0
I20260810 18:40:44.671612 6351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:44.682120 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6261
W20260810 18:40:44.683238 6329 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43509
W20260810 18:40:44.684051 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6261: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:44.684206 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6261
2026-08-10T18:40:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2083 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:44 dist-test-slave-5k54 krb5kdc[6370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:44 dist-test-slave-5k54 krb5kdc[6370](info): set up 2 sockets
Aug 10 18:40:44 dist-test-slave-5k54 krb5kdc[6370](info): commencing operation
krb5kdc: starting...
W20260810 18:40:45.897815 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.001s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:46 dist-test-slave-5k54 krb5kdc[6370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387246, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:46.234236 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43623
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:46679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:43623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:46.572610 6385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:46.572906 6385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:46.573091 6385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:46.580251 6385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:46.580361 6385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:46.580448 6385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:46.580550 6385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:46.580636 6385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:46.590453 6385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:46679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:43623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:43623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:46.591781 6385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:46.593087 6385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:46.605123 6392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:46.604969 6396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:46.605050 6393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:46.606470 6385 server_base.cc:1034] running on GCE node
I20260810 18:40:46.607334 6385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:46.608721 6385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:46.609959 6385 hybrid_clock.cc:648] HybridClock initialized: now 1786387246609915 us; error 54 us; skew 500 ppm
I20260810 18:40:46.610318 6385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:46 dist-test-slave-5k54 krb5kdc[6370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387246, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:46.613595 6385 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:46.615180 6385 webserver.cc:460] Webserver started at http://127.13.139.62:36217/ using document root <none> and password file <none>
I20260810 18:40:46.615878 6385 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:46.615981 6385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:46.616225 6385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:46.619074 6385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "c171974399ec46c88575478e48437c11"
format_stamp: "Formatted at 2026-08-10 18:40:46 on dist-test-slave-5k54"
server_key: "854d5d8097c4f020b2517f58cbd57342"
server_key_iv: "8bb660fb0ab86b5fae383cbf36f4f3fb"
server_key_version: "encryptionkey@0"
I20260810 18:40:46.619858 6385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "c171974399ec46c88575478e48437c11"
format_stamp: "Formatted at 2026-08-10 18:40:46 on dist-test-slave-5k54"
server_key: "854d5d8097c4f020b2517f58cbd57342"
server_key_iv: "8bb660fb0ab86b5fae383cbf36f4f3fb"
server_key_version: "encryptionkey@0"
I20260810 18:40:46.624902 6385 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 18:40:46.629307 6404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:46.630652 6385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260810 18:40:46.630836 6385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "c171974399ec46c88575478e48437c11"
format_stamp: "Formatted at 2026-08-10 18:40:46 on dist-test-slave-5k54"
server_key: "854d5d8097c4f020b2517f58cbd57342"
server_key_iv: "8bb660fb0ab86b5fae383cbf36f4f3fb"
server_key_version: "encryptionkey@0"
I20260810 18:40:46.631033 6385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:46.636722 6385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:46.640764 6385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:46.641052 6385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:46.660240 6385 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:43623
I20260810 18:40:46.660291 6462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:43623 every 8 connection(s)
I20260810 18:40:46.661636 6385 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:46.665421 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6385
I20260810 18:40:46.665630 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:46.665729 6463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:46.666289 13868 external_mini_cluster.cc:1428] Setting key af6777aabdeeda0a987b5572e1ff5968
I20260810 18:40:46.674168 6467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:46.668222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38667 (local address 127.13.139.62:43623)
0810 18:40:46.669211 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:46.669222 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:46.669260 (+ 38us) server_negotiation.cc:407] Connection header received
0810 18:40:46.670857 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:46.670878 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:46.671191 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:46.671633 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:46.672671 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:46.672677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:46.672691 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:46.672707 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:46.672762 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:46.672779 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:46.673027 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:46.673156 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 18:40:46.673318 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":473,"threads_started":1}
I20260810 18:40:46.677763 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:46.679740 6463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11: Bootstrap starting.
I20260810 18:40:46.684020 6463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:46.684866 6467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:46.682150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44657 (local address 127.13.139.62:43623)
0810 18:40:46.682348 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:46.682353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:46.682676 (+ 323us) server_negotiation.cc:407] Connection header received
0810 18:40:46.682954 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:46.682958 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:46.683021 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:46.683104 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:46.684184 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:46.684189 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:46.684192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 18:40:46.684208 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:46.684248 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 18:40:46.684262 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:46.684354 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:46.684515 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 18:40:46.684563 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:40:46.685405 6463 log.cc:824] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:46.688207 6463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11: No bootstrap required, opened a new log
I20260810 18:40:46.695153 6463 raft_consensus.cc:348] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c171974399ec46c88575478e48437c11" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43623 } }
I20260810 18:40:46.695561 6463 raft_consensus.cc:374] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 18:40:46.695653 6463 raft_consensus.cc:729] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c171974399ec46c88575478e48437c11, State: Initialized, Role: FOLLOWER
I20260810 18:40:46.696159 6463 consensus_queue.cc:260] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c171974399ec46c88575478e48437c11" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43623 } }
I20260810 18:40:46.696367 6463 raft_consensus.cc:388] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 18:40:46.696461 6463 raft_consensus.cc:482] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 18:40:46.696580 6463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:46.698671 6463 raft_consensus.cc:504] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c171974399ec46c88575478e48437c11" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43623 } }
I20260810 18:40:46.699278 6463 leader_election.cc:302] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c171974399ec46c88575478e48437c11; no voters:
I20260810 18:40:46.700089 6463 leader_election.cc:288] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 18:40:46.700205 6475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:46.701033 6475 raft_consensus.cc:686] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [term 1 LEADER]: Becoming Leader. State: Replica: c171974399ec46c88575478e48437c11, State: Running, Role: LEADER
I20260810 18:40:46.701602 6475 consensus_queue.cc:237] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c171974399ec46c88575478e48437c11" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43623 } }
I20260810 18:40:46.702410 6463 sys_catalog.cc:564] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:46.704358 6476 sys_catalog.cc:455] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c171974399ec46c88575478e48437c11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c171974399ec46c88575478e48437c11" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43623 } } }
I20260810 18:40:46.705574 6476 sys_catalog.cc:458] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:46.705363 6477 sys_catalog.cc:455] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c171974399ec46c88575478e48437c11. Latest consensus state: current_term: 1 leader_uuid: "c171974399ec46c88575478e48437c11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c171974399ec46c88575478e48437c11" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 43623 } } }
I20260810 18:40:46.706077 6477 sys_catalog.cc:458] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:46.708510 6483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:46.714424 6483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:46.724416 6483 catalog_manager.cc:1347] Generated new cluster ID: f6d6140cddba490bbb47afaa21a53c23
I20260810 18:40:46.724543 6483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:46.753852 6483 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:46.754381 6483 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:46.766932 6483 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c171974399ec46c88575478e48437c11: Generated new TSK 0
I20260810 18:40:46.767974 6483 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:46.774201 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6385
W20260810 18:40:46.775552 6458 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38667
W20260810 18:40:46.776266 13868 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6385: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260810 18:40:46.776427 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6385
2026-08-10T18:40:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2089 ms)
[----------] 18 tests from AuthTokenIssuingTest (38115 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:46 dist-test-slave-5k54 krb5kdc[6499](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:46 dist-test-slave-5k54 krb5kdc[6499](info): set up 2 sockets
Aug 10 18:40:46 dist-test-slave-5k54 krb5kdc[6499](info): commencing operation
krb5kdc: starting...
W20260810 18:40:48.006909 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.003s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:48 dist-test-slave-5k54 krb5kdc[6499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:48.331600 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36919
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:36919,127.13.139.61:42853,127.13.139.60:37633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:48.670562 6515 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 18:40:48.670950 6515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:48.671059 6515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:48.671197 6515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:48.678360 6515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:48.678443 6515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:48.678555 6515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:48.678653 6515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:48.678741 6515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:48.688566 6515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:36919,127.13.139.61:42853,127.13.139.60:37633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:36919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:48.689921 6515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:48.691288 6515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:48.703162 6520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:48.703207 6523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:48.703248 6521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:48.704414 6515 server_base.cc:1034] running on GCE node
I20260810 18:40:48.705211 6515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:48.706543 6515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:48.707765 6515 hybrid_clock.cc:648] HybridClock initialized: now 1786387248707713 us; error 32 us; skew 500 ppm
I20260810 18:40:48.708137 6515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:48 dist-test-slave-5k54 krb5kdc[6499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:48.711504 6515 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:48.713066 6515 webserver.cc:460] Webserver started at http://127.13.139.62:41839/ using document root <none> and password file <none>
I20260810 18:40:48.713755 6515 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:48.713855 6515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:48.714223 6515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:48.717276 6515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "8e7159623a8e4db2aba75bbce17ca767"
format_stamp: "Formatted at 2026-08-10 18:40:48 on dist-test-slave-5k54"
server_key: "443b493be82eb85e68b8e9d5df2f3e78"
server_key_iv: "139b2e7d878f93152d3c9d74cad7c257"
server_key_version: "encryptionkey@0"
I20260810 18:40:48.718109 6515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "8e7159623a8e4db2aba75bbce17ca767"
format_stamp: "Formatted at 2026-08-10 18:40:48 on dist-test-slave-5k54"
server_key: "443b493be82eb85e68b8e9d5df2f3e78"
server_key_iv: "139b2e7d878f93152d3c9d74cad7c257"
server_key_version: "encryptionkey@0"
I20260810 18:40:48.723363 6515 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260810 18:40:48.726866 6530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:48.728286 6515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 18:40:48.728466 6515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "8e7159623a8e4db2aba75bbce17ca767"
format_stamp: "Formatted at 2026-08-10 18:40:48 on dist-test-slave-5k54"
server_key: "443b493be82eb85e68b8e9d5df2f3e78"
server_key_iv: "139b2e7d878f93152d3c9d74cad7c257"
server_key_version: "encryptionkey@0"
I20260810 18:40:48.728645 6515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:48.752791 6515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:48.757387 6515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:48.757681 6515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:48.777089 6515 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:36919
I20260810 18:40:48.777113 6584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:36919 every 8 connection(s)
I20260810 18:40:48.778440 6515 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:48.782243 6585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:48.783600 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6515
I20260810 18:40:48.783849 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:48.784705 13868 external_mini_cluster.cc:1428] Setting key 6e116311c20492744292c3fff5051452
I20260810 18:40:48.792193 6585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:48 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:48.818738 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.796112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36919 (local address 127.0.0.1:40274)
0810 18:40:48.797087 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:48.797140 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:48.800092 (+ 2952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:48.801072 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:48.801077 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:48.801656 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:48.801981 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:48.801997 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:48.804418 (+ 2421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:48.804422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:48.805513 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:48.805525 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:48.806892 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:48.806897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:48.807024 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:48.807749 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:48.807776 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:48.809956 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:48.814514 (+ 4558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:48.814525 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:48.814533 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:48.814936 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:48.815528 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:48.815532 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:48.815534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:48.815693 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:48.816732 (+ 1039us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:48.816738 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:48.816955 (+ 217us) client_negotiation.cc:769] Sending connection context
0810 18:40:48.817172 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 18:40:48.817594 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":399,"threads_started":1}
I20260810 18:40:48.818776 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.796112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40274 (local address 127.13.139.62:36919)
0810 18:40:48.798054 (+ 1942us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:48.798060 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:48.798102 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:40:48.800480 (+ 2378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:48.800490 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:48.800805 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:48.801062 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:48.802209 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:48.804270 (+ 2061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:48.805659 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:48.806669 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:48.806863 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:48.810209 (+ 3346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:48.810223 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:48.810241 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:48.810290 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:48.814378 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:48.815104 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:48.815116 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:48.815122 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:48.815324 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:48.815812 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:48.815821 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:48.815827 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:48.816582 (+ 755us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:48.816812 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:48.817402 (+ 590us) server_negotiation.cc:299] Negotiation successful
0810 18:40:48.817825 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":1743,"spinlock_wait_cycles":15232,"thread_start_us":1499,"threads_started":1}
WARNING: no policy specified for kudu/127.13.139.61@KRBTEST.COM; defaulting to no policy
I20260810 18:40:48.822269 6585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:40:48.823519 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.823041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47162)
0810 18:40:48.823237 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:48.823341 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.61@KRBTEST.COM" created.
W20260810 18:40:48.823920 6533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
I20260810 18:40:48.825692 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.825202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47172)
0810 18:40:48.825397 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:48.825515 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260810 18:40:48.825930 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:42853: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab.
Entry for principal kudu/127.13.139.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab.
I20260810 18:40:48.861017 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:42853
--webserver_interface=127.13.139.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab
--principal=kudu/127.13.139.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:36919,127.13.139.61:42853,127.13.139.60:37633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:40:48.875638 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } attempt: 1
I20260810 18:40:48.877908 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.876601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47184)
0810 18:40:48.877566 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:48.877712 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":802}
I20260810 18:40:48.879729 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.879169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47192)
0810 18:40:48.879410 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:48.879539 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260810 18:40:48.879938 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:42853: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
I20260810 18:40:48.948233 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } attempt: 2
I20260810 18:40:48.949622 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.949022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47202)
0810 18:40:48.949316 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:48.949448 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260810 18:40:48.950721 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:48.950315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47212)
0810 18:40:48.950475 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:48.950572 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260810 18:40:48.950928 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:42853: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
I20260810 18:40:49.042199 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } attempt: 3
I20260810 18:40:49.043628 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.042979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47226)
0810 18:40:49.043251 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.043403 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260810 18:40:49.045171 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.044601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47234)
0810 18:40:49.044840 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.044953 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260810 18:40:49.045444 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:42853: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
I20260810 18:40:49.188741 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } attempt: 4
I20260810 18:40:49.190085 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.189433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47250)
0810 18:40:49.189785 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.189911 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260810 18:40:49.191166 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.190764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47254)
0810 18:40:49.190921 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.191018 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 18:40:49.191367 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:42853: Network error: Client connection negotiation failed: client connection to 127.13.139.61:42853: connect: Connection refused (error 111)
W20260810 18:40:49.204582 6594 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 18:40:49.204903 6594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:49.204977 6594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:49.205060 6594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:49.212119 6594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:49.212204 6594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:49.212262 6594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:49.212314 6594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:49.212369 6594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:49.221881 6594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:36919,127.13.139.61:42853,127.13.139.60:37633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab
--principal=kudu/127.13.139.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:42853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.139.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:49.223096 6594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:49.224355 6594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:49.236022 6601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:49.236071 6603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:49.236131 6600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:49.237159 6594 server_base.cc:1034] running on GCE node
I20260810 18:40:49.237864 6594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:49.239224 6594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:49.240471 6594 hybrid_clock.cc:648] HybridClock initialized: now 1786387249240390 us; error 56 us; skew 500 ppm
I20260810 18:40:49.240800 6594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:49.244118 6594 init.cc:377] Logged in from keytab as kudu/127.13.139.61@KRBTEST.COM (short username kudu)
I20260810 18:40:49.245540 6594 webserver.cc:460] Webserver started at http://127.13.139.61:43357/ using document root <none> and password file <none>
I20260810 18:40:49.246173 6594 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:49.246259 6594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:49.246521 6594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:49.249413 6594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data/instance:
uuid: "e654cebcc55d4236a6f27e7444aec54f"
format_stamp: "Formatted at 2026-08-10 18:40:49 on dist-test-slave-5k54"
server_key: "73bcd365ccf00733e3b79942a19e4e40"
server_key_iv: "82108d1df222185cc3ea99de50f798b0"
server_key_version: "encryptionkey@0"
I20260810 18:40:49.250135 6594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/wal/instance:
uuid: "e654cebcc55d4236a6f27e7444aec54f"
format_stamp: "Formatted at 2026-08-10 18:40:49 on dist-test-slave-5k54"
server_key: "73bcd365ccf00733e3b79942a19e4e40"
server_key_iv: "82108d1df222185cc3ea99de50f798b0"
server_key_version: "encryptionkey@0"
I20260810 18:40:49.255149 6594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260810 18:40:49.258502 6612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:49.259812 6594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 18:40:49.260035 6594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/wal
uuid: "e654cebcc55d4236a6f27e7444aec54f"
format_stamp: "Formatted at 2026-08-10 18:40:49 on dist-test-slave-5k54"
server_key: "73bcd365ccf00733e3b79942a19e4e40"
server_key_iv: "82108d1df222185cc3ea99de50f798b0"
server_key_version: "encryptionkey@0"
I20260810 18:40:49.260236 6594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:49.273010 6594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:49.277240 6594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:49.277470 6594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:49.296273 6594 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.61:42853
I20260810 18:40:49.296293 6665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.61:42853 every 8 connection(s)
I20260810 18:40:49.297632 6594 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
I20260810 18:40:49.301317 6666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:49.305121 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6594
I20260810 18:40:49.305325 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-1/wal/instance
I20260810 18:40:49.305757 13868 external_mini_cluster.cc:1428] Setting key 5996f94fe6da2d19c99db3688bb4646a
I20260810 18:40:49.307915 6666 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:49.331902 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.310594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40286 (local address 127.13.139.62:36919)
0810 18:40:49.310774 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.310779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.312042 (+ 1263us) server_negotiation.cc:407] Connection header received
0810 18:40:49.314531 (+ 2489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.314540 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.314637 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.314752 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.316629 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.317727 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.319914 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.320670 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.320817 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.324579 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.324588 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.324596 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.324643 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.328520 (+ 3877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.329289 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.329297 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.329303 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.329484 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.329891 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.329898 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.329904 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.330317 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.330485 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.331165 (+ 680us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.331466 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 18:40:49.332882 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.311037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36919 (local address 127.0.0.1:40286)
0810 18:40:49.311862 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.311902 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:49.314201 (+ 2299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:49.314968 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:49.314979 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:49.315713 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:49.316420 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.316442 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.317886 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.317893 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.319753 (+ 1860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.319765 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.320902 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.320908 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.321108 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.321801 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:49.321823 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:49.324312 (+ 2489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:49.328683 (+ 4371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.328690 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.328702 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.329140 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.329601 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.329605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.329607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.329767 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.330447 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:49.330453 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:49.330763 (+ 310us) client_negotiation.cc:769] Sending connection context
0810 18:40:49.331000 (+ 237us) client_negotiation.cc:240] Negotiation successful
0810 18:40:49.331543 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":394,"threads_started":1}
I20260810 18:40:49.334782 6666 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.139.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.60@KRBTEST.COM" created.
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:40:49.351387 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.335608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47258)
0810 18:40:49.335813 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.335837 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:49.335947 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:49.337053 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:49.337060 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:49.337620 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:49.337868 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.337884 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.339241 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.339247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.340756 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.340768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.341677 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.341681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.341814 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.342398 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:49.342415 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:49.344664 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:49.349025 (+ 4361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.349029 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.349032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.349441 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.349852 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.349855 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.349858 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.349996 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.350709 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:49.350712 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:49.350824 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 18:40:49.350926 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 18:40:49.351110 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 18:40:49.351974 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.335945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47258 (local address 127.13.139.61:42853)
0810 18:40:49.336631 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.336637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.336661 (+ 24us) server_negotiation.cc:407] Connection header received
0810 18:40:49.336704 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.336710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.336874 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.336992 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.338057 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.339095 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.340933 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.341531 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.341632 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.344897 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.344913 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.344933 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.344977 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.348877 (+ 3900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.349583 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.349594 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.349600 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.349744 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.350108 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.350115 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.350121 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.350591 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.350806 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.351159 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.351480 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":391,"threads_started":1}
I20260810 18:40:49.354323 6666 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:40:49.355594 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.355109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49660)
0810 18:40:49.355275 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.355391 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 18:40:49.355865 6616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.357405 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.357100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49666)
0810 18:40:49.357241 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.357314 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 18:40:49.357664 6666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab.
Entry for principal kudu/127.13.139.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab.
I20260810 18:40:49.383548 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:37633
--webserver_interface=127.13.139.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab
--principal=kudu/127.13.139.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:36919,127.13.139.61:42853,127.13.139.60:37633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:40:49.406978 6666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 1
I20260810 18:40:49.408298 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.407800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49674)
0810 18:40:49.408010 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.408126 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 18:40:49.409446 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.409042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49688)
0810 18:40:49.409236 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.409320 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260810 18:40:49.409670 6666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.477870 6666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 2
I20260810 18:40:49.479043 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.478529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49700)
0810 18:40:49.478735 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.478860 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 18:40:49.480141 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.479803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49716)
0810 18:40:49.479956 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.480030 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 18:40:49.480337 6666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.490667 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } attempt: 5
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:40:49.505246 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.491468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47272 (local address 127.13.139.61:42853)
0810 18:40:49.491636 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.491642 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.491665 (+ 23us) server_negotiation.cc:407] Connection header received
0810 18:40:49.491802 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.491809 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.491909 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.492027 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.492772 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.493911 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.495070 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.495828 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.495968 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.499689 (+ 3721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.499694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.499697 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.499730 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.502395 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.503341 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.503345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.503347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.503526 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.504008 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.504012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.504014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.504280 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.504390 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.504853 (+ 463us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.505028 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:40:49.506187 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.491356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47272)
0810 18:40:49.491552 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.491571 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:49.491680 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:49.492061 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:49.492065 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:49.492448 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:49.492621 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.492630 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.494060 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.494064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.494921 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.494933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.496014 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.496019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.496183 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.496890 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:49.496908 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:49.499506 (+ 2598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:49.502558 (+ 3052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.502567 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.502572 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.503221 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.503648 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.503655 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.503660 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.503892 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.504410 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:49.504415 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:49.504598 (+ 183us) client_negotiation.cc:769] Sending connection context
0810 18:40:49.504759 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 18:40:49.505746 (+ 987us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260810 18:40:49.507335 6585 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:40:49.508476 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.508025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49724)
0810 18:40:49.508218 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.508314 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 18:40:49.509433 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.509080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49738)
0810 18:40:49.509221 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.509316 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 18:40:49.509637 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.560907 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 1
I20260810 18:40:49.562286 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.561705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49742)
0810 18:40:49.561945 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.562064 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260810 18:40:49.563344 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.562976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49746)
0810 18:40:49.563125 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.563211 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 18:40:49.563580 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.571518 6666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 3
I20260810 18:40:49.572477 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.572064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49750)
0810 18:40:49.572259 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.572341 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 18:40:49.573499 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.573096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49766)
0810 18:40:49.573318 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.573392 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260810 18:40:49.573683 6666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.631837 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 2
I20260810 18:40:49.633209 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.632568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49780)
0810 18:40:49.632850 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.632979 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260810 18:40:49.634233 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.633917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49792)
0810 18:40:49.634049 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.634116 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 18:40:49.634517 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.716895 6666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 4
I20260810 18:40:49.718153 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.717641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49808)
0810 18:40:49.717860 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.717979 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 18:40:49.719184 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.718854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49812)
0810 18:40:49.719016 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.719081 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260810 18:40:49.719376 6666 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
W20260810 18:40:49.732900 6673 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 18:40:49.733263 6673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:49.733384 6673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:49.733521 6673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 18:40:49.740724 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 3
W20260810 18:40:49.741657 6673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:49.741768 6673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:49.741863 6673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:49.741967 6673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260810 18:40:49.741955 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.741418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49814)
0810 18:40:49.741629 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.741718 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260810 18:40:49.742075 6673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:49.743024 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.742628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49820)
0810 18:40:49.742835 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.742928 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260810 18:40:49.743248 6585 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:37633: Network error: Client connection negotiation failed: client connection to 127.13.139.60:37633: connect: Connection refused (error 111)
I20260810 18:40:49.752300 6673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:36919,127.13.139.61:42853,127.13.139.60:37633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab
--principal=kudu/127.13.139.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:37633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.139.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:49.753780 6673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:49.755137 6673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:49.767313 6679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:49.767267 6680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:49.767354 6682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:49.767851 6673 server_base.cc:1034] running on GCE node
I20260810 18:40:49.768659 6673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:49.769968 6673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:49.771195 6673 hybrid_clock.cc:648] HybridClock initialized: now 1786387249771118 us; error 37 us; skew 500 ppm
I20260810 18:40:49.771602 6673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:49.774845 6673 init.cc:377] Logged in from keytab as kudu/127.13.139.60@KRBTEST.COM (short username kudu)
I20260810 18:40:49.776363 6673 webserver.cc:460] Webserver started at http://127.13.139.60:38619/ using document root <none> and password file <none>
I20260810 18:40:49.777222 6673 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:49.777354 6673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:49.777769 6673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:49.781580 6673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data/instance:
uuid: "005448e689d24cd1bb8bf5404027cfa2"
format_stamp: "Formatted at 2026-08-10 18:40:49 on dist-test-slave-5k54"
server_key: "a3993b9f925a9003ce9fa7bcbd9c5405"
server_key_iv: "2e535436f4e990a33333216c005fc1ec"
server_key_version: "encryptionkey@0"
I20260810 18:40:49.782586 6673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/wal/instance:
uuid: "005448e689d24cd1bb8bf5404027cfa2"
format_stamp: "Formatted at 2026-08-10 18:40:49 on dist-test-slave-5k54"
server_key: "a3993b9f925a9003ce9fa7bcbd9c5405"
server_key_iv: "2e535436f4e990a33333216c005fc1ec"
server_key_version: "encryptionkey@0"
I20260810 18:40:49.788856 6673 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260810 18:40:49.792243 6691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:49.793538 6673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:49.793721 6673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/wal
uuid: "005448e689d24cd1bb8bf5404027cfa2"
format_stamp: "Formatted at 2026-08-10 18:40:49 on dist-test-slave-5k54"
server_key: "a3993b9f925a9003ce9fa7bcbd9c5405"
server_key_iv: "2e535436f4e990a33333216c005fc1ec"
server_key_version: "encryptionkey@0"
I20260810 18:40:49.793987 6673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:49.832955 6673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:49.837216 6673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:49.837531 6673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:49.856290 6673 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.60:37633
I20260810 18:40:49.856310 6748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.60:37633 every 8 connection(s)
I20260810 18:40:49.857700 6673 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
I20260810 18:40:49.861336 6750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:49.865929 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6673
I20260810 18:40:49.866138 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786386879896169-13868-0/minicluster-data/master-2/wal/instance
I20260810 18:40:49.866667 13868 external_mini_cluster.cc:1428] Setting key 89b311b5b870ba29e4b58d9697b67e2f
I20260810 18:40:49.868980 6750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:40:49.889315 6755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.871613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.13.139.62:36919)
0810 18:40:49.872149 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.872157 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.872802 (+ 645us) server_negotiation.cc:407] Connection header received
0810 18:40:49.873002 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.873008 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.873079 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.873170 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.874815 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.876046 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.878157 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.878760 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.878887 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.882830 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.882840 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.882846 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.882899 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.885936 (+ 3037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.886674 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.886680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.886684 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.886833 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.887321 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.887325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.887328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.887692 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.887797 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.888610 (+ 813us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.888833 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":281,"threads_started":1}
I20260810 18:40:49.890424 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.868667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49824 (local address 127.13.139.60:37633)
0810 18:40:49.869492 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.869506 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.869548 (+ 42us) server_negotiation.cc:407] Connection header received
0810 18:40:49.871394 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.871442 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.872002 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.872502 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.874380 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.876184 (+ 1804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.877959 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.878701 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.878899 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.883526 (+ 4627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.883534 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.883545 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.883572 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.886234 (+ 2662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.886962 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.886970 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.886973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.887174 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.887622 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.887625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.887627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.888203 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.888504 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.888786 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.889128 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":113,"server-negotiator.queue_time_us":605,"spinlock_wait_cycles":1280,"thread_start_us":404,"threads_started":1}
I20260810 18:40:49.890462 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.871580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:36919 (local address 127.0.0.1:40288)
0810 18:40:49.872633 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.872693 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:49.872845 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:49.873274 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:49.873282 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:49.874137 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:49.874648 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.874663 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.876193 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.876196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.878030 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.878041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.879000 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.879008 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.879174 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.879977 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:49.880009 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:49.882627 (+ 2618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:49.886063 (+ 3436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.886075 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.886087 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.886558 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.886971 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.886975 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.886978 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.887220 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.887803 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:49.887810 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:49.888208 (+ 398us) client_negotiation.cc:769] Sending connection context
0810 18:40:49.888504 (+ 296us) client_negotiation.cc:240] Negotiation successful
0810 18:40:49.889007 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"mutex_wait_us":48,"spinlock_wait_cycles":33024,"thread_start_us":533,"threads_started":1}
I20260810 18:40:49.892095 6750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:49.905689 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.892917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:42853 (local address 127.0.0.1:47288)
0810 18:40:49.893098 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.893116 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:49.893217 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:49.893584 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:49.893588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:49.894068 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:49.894248 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.894263 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.895229 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.895234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.896188 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.896199 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.896902 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.896907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.897087 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.897709 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:49.897733 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:49.900202 (+ 2469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:49.903286 (+ 3084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.903291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.903295 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.903725 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.904124 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.904131 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.904134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.904284 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.904802 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:49.904807 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:49.904963 (+ 156us) client_negotiation.cc:769] Sending connection context
0810 18:40:49.905103 (+ 140us) client_negotiation.cc:240] Negotiation successful
0810 18:40:49.905357 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 18:40:49.905928 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.893154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47288 (local address 127.13.139.61:42853)
0810 18:40:49.893323 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.893327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.893343 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:40:49.893398 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.893401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.893455 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.893567 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.894415 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.895085 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.896330 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.896751 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.896880 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.900394 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.900406 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.900409 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.900443 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.903134 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.903865 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.903879 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.903881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.904015 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.904411 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.904415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.904417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.904663 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.904842 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.905209 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.905438 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 18:40:49.906878 6750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:40:49.907786 6755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.893538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40298 (local address 127.13.139.62:36919)
0810 18:40:49.893833 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.893839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.893854 (+ 15us) server_negotiation.cc:407] Connection header received
0810 18:40:49.893904 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.893910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.893988 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.894088 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.895151 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.895907 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.897136 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.897589 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.897715 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.902356 (+ 4641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.902362 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.902367 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.902406 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.905013 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.905623 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.905630 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.905633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.905781 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.906227 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.906234 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.906240 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.906610 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.906877 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.907262 (+ 385us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.907532 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:40:49.919826 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.908068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49834 (local address 127.13.139.60:37633)
0810 18:40:49.908244 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.908249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.908268 (+ 19us) server_negotiation.cc:407] Connection header received
0810 18:40:49.908317 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.908320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.908369 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.908441 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.909242 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.909922 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.911010 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.911408 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.911586 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.914528 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.914537 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.914542 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.914581 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.917120 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.917901 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.917905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.917908 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.918036 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.918382 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.918387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.918390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.918744 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.918883 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.919339 (+ 456us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.919554 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:40:49.920154 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.907727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49834)
0810 18:40:49.907880 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.907899 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:49.908010 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:49.908503 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:49.908508 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:49.908918 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:49.909094 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.909107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.910054 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.910059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.910870 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.910880 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.911589 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.911594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.911804 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.912318 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:49.912334 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:49.914342 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:49.917239 (+ 2897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.917246 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.917252 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.917760 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.918146 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.918153 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.918156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.918286 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.918908 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:49.918913 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:49.919078 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 18:40:49.919280 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 18:40:49.919757 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":127}
I20260810 18:40:49.920440 6585 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 4
I20260810 18:40:49.924368 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.909648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47298 (local address 127.13.139.61:42853)
0810 18:40:49.909784 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.909787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.909800 (+ 13us) server_negotiation.cc:407] Connection header received
0810 18:40:49.909835 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.909838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.909883 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.909983 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.911130 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.911890 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.913104 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.913837 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.913962 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.918103 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.918107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.918110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.918138 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.921336 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.922168 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.922175 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.922178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.922341 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.922828 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.922833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.922836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.923196 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.923516 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.923831 (+ 315us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.924060 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 18:40:49.926851 6750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: Bootstrap starting.
I20260810 18:40:49.929680 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 10 18:40:49 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387248, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:40:49.930984 6750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:49.932590 6750 log.cc:824] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:49.936206 6750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: No bootstrap required, opened a new log
I20260810 18:40:49.939440 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.921750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.13.139.60:37633)
0810 18:40:49.921935 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.921938 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:49.921951 (+ 13us) server_negotiation.cc:407] Connection header received
0810 18:40:49.922006 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:49.922010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:49.922067 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:49.922205 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:49.923144 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.924448 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.926724 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.927407 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.927593 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.931764 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:49.931770 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:49.931775 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:49.931814 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:49.936066 (+ 4252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.937033 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.937045 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.937051 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.937225 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:49.937670 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:49.937676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:49.937680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:49.938197 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:49.938386 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:49.938829 (+ 443us) server_negotiation.cc:299] Negotiation successful
0810 18:40:49.939042 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 18:40:49.939765 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.921078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49840)
0810 18:40:49.921418 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:49.921441 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:49.921547 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:49.922245 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:49.922252 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:49.922785 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:49.922988 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.923002 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.924618 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.924624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.926032 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:49.926046 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:49.927635 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:49.927641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:49.927869 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:49.928559 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:49.928585 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:49.931553 (+ 2968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:49.936211 (+ 4658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.936253 (+ 42us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.936257 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.936859 (+ 602us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.937402 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:49.937407 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:49.937411 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:49.937557 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:49.938347 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:49.938355 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:49.938550 (+ 195us) client_negotiation.cc:769] Sending connection context
0810 18:40:49.938711 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 18:40:49.939030 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217}
I20260810 18:40:49.938226 6557 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "8e7159623a8e4db2aba75bbce17ca767"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40298
I20260810 18:40:49.945276 6585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767: Bootstrap starting.
I20260810 18:40:49.947955 6750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
I20260810 18:40:49.948402 6750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005448e689d24cd1bb8bf5404027cfa2, State: Initialized, Role: FOLLOWER
I20260810 18:40:49.948493 6585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:49.948879 6750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
I20260810 18:40:49.949887 6585 log.cc:824] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:49.949963 6758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:49.950568 6758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:49.951102 6750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:49.953174 6585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767: No bootstrap required, opened a new log
I20260810 18:40:49.961234 6585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
W20260810 18:40:49.961525 6770 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 18:40:49.961660 6585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7159623a8e4db2aba75bbce17ca767, State: Initialized, Role: FOLLOWER
W20260810 18:40:49.961808 6770 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:40:49.962113 6585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
I20260810 18:40:49.963037 6772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:49.963510 6772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:49.964146 6585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:49.964370 6557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 18:40:49.964599 6557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:49.968014 6557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
I20260810 18:40:49.959153 6673 master_runner.cc:186] Error getting master registration for 127.13.139.62:36919: OK, instance_id { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" instance_seqno: 1786387248771741 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 18:40:49.969931 6673 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 18:40:49.970345 6557 leader_election.cc:288] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [CANDIDATE]: Term 1 election: Requested vote from peers e654cebcc55d4236a6f27e7444aec54f (127.13.139.61:42853), 005448e689d24cd1bb8bf5404027cfa2 (127.13.139.60:37633)
I20260810 18:40:49.970296 6721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8e7159623a8e4db2aba75bbce17ca767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "005448e689d24cd1bb8bf5404027cfa2"
I20260810 18:40:49.970815 6721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:49.974973 6721 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7159623a8e4db2aba75bbce17ca767 in term 1.
I20260810 18:40:49.975688 6534 leader_election.cc:302] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005448e689d24cd1bb8bf5404027cfa2, 8e7159623a8e4db2aba75bbce17ca767; no voters:
I20260810 18:40:49.976120 6772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 18:40:49.980243 6785 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:40:49.980394 6785 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:40:49.992450 6772 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [term 1 LEADER]: Becoming Leader. State: Replica: 8e7159623a8e4db2aba75bbce17ca767, State: Running, Role: LEADER
I20260810 18:40:49.993063 6772 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
I20260810 18:40:50.005915 6788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e7159623a8e4db2aba75bbce17ca767. Latest consensus state: current_term: 1 leader_uuid: "8e7159623a8e4db2aba75bbce17ca767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.006426 6788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:50.008283 6797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:50.010833 6797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260810 18:40:50.015753 6536 tablet.cc:2369] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:50.018626 6666 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } attempt: 5
I20260810 18:40:50.008164 6515 master_runner.cc:186] Error getting master registration for 127.13.139.61:42853: OK, instance_id { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" instance_seqno: 1786387249290811 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 18:40:50.032752 6515 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 10 18:40:50 dist-test-slave-5k54 krb5kdc[6499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387249, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:40:50.047766 6668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.019254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:37633 (local address 127.0.0.1:49846)
0810 18:40:50.019455 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:50.019479 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:50.019596 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:50.029644 (+ 10048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:50.029650 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:50.030228 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:50.030456 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:50.030470 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.032337 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.032343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:50.033816 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:50.033836 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.034963 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.034969 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:50.035246 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.037110 (+ 1864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:50.037132 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:50.040107 (+ 2975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:50.044621 (+ 4514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:50.044627 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:50.044630 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:50.045209 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:50.045714 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:50.045721 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:50.045726 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:50.045905 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:50.046703 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:50.046709 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:50.046875 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 18:40:50.047051 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 18:40:50.047354 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":1140}
I20260810 18:40:50.049367 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.019683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49846 (local address 127.13.139.60:37633)
0810 18:40:50.023995 (+ 4312us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.024001 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.024028 (+ 27us) server_negotiation.cc:407] Connection header received
0810 18:40:50.024094 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.024100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.024184 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.030633 (+ 6449us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.030925 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.032174 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.034042 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.034753 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.034897 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.040406 (+ 5509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:50.040415 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:50.040423 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:50.040467 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:50.044464 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.045375 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.045380 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.045383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.045561 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.046053 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.046059 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.046062 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.046459 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:50.046622 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.048511 (+ 1889us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.048745 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4154,"thread_start_us":3938,"threads_started":1}
I20260810 18:40:50.052815 6755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.983805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.13.139.62:36919)
0810 18:40:49.983968 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.983974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.003816 (+ 19842us) server_negotiation.cc:407] Connection header received
0810 18:40:50.004440 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.004450 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.004569 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.004664 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.014638 (+ 9974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.015938 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.036741 (+ 20803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.037443 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.037551 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.043062 (+ 5511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:50.043075 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:50.043084 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:50.043135 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:50.047026 (+ 3891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.048652 (+ 1626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.048660 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.048667 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.048831 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.049600 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.049605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.049608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.049999 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:50.050273 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.051469 (+ 1196us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.052035 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 18:40:50.056483 6666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f: Bootstrap starting.
I20260810 18:40:50.060899 6666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:50.062099 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.984057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49842 (local address 127.13.139.60:37633)
0810 18:40:49.984274 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.984282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.032833 (+ 48551us) server_negotiation.cc:407] Connection header received
0810 18:40:50.033089 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.033094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.033167 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.033232 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.038433 (+ 5201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.039547 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.044898 (+ 5351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.045934 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.046044 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.051756 (+ 5712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:50.051764 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:50.051772 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:50.051823 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:50.055324 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.056140 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.056146 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.056149 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.056293 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.060258 (+ 3965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.060263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.060266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.060629 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:50.060889 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.061495 (+ 606us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.061749 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 18:40:50.062268 6666 log.cc:824] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:50.064333 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:49.983272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47306 (local address 127.13.139.61:42853)
0810 18:40:49.983521 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:49.983530 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.012528 (+ 28998us) server_negotiation.cc:407] Connection header received
0810 18:40:50.032769 (+ 20241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.032778 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.032876 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.033022 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.035157 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.036314 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.043129 (+ 6815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.043806 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.043925 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.056222 (+ 12297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:50.056230 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:50.056236 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:50.056272 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:50.059965 (+ 3693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.061287 (+ 1322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.061296 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.061302 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.061481 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:50.062194 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:50.062200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:50.062203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:50.062606 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:50.062867 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.063501 (+ 634us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.063733 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":72}
I20260810 18:40:50.067773 6666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f: No bootstrap required, opened a new log
I20260810 18:40:50.074509 6721 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [term 1 FOLLOWER]: Refusing update from remote peer 8e7159623a8e4db2aba75bbce17ca767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:50.075932 6772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:50.080150 6666 raft_consensus.cc:348] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
I20260810 18:40:50.080582 6666 raft_consensus.cc:729] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e654cebcc55d4236a6f27e7444aec54f, State: Initialized, Role: FOLLOWER
I20260810 18:40:50.081091 6666 consensus_queue.cc:260] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } }
I20260810 18:40:50.088519 6801 sys_catalog.cc:455] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.088936 6801 sys_catalog.cc:458] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [sys.catalog]: This master's current role is: FOLLOWER
W20260810 18:40:50.089784 6697 tablet.cc:2369] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:50.090787 6666 sys_catalog.cc:564] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:50.091240 6639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:50.091703 6640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8e7159623a8e4db2aba75bbce17ca767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e654cebcc55d4236a6f27e7444aec54f"
I20260810 18:40:50.096195 6639 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [term 1 FOLLOWER]: Refusing update from remote peer 8e7159623a8e4db2aba75bbce17ca767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:50.100049 6640 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7159623a8e4db2aba75bbce17ca767 in term 1.
I20260810 18:40:50.102710 6772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:50.118778 6758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e7159623a8e4db2aba75bbce17ca767. Latest consensus state: current_term: 1 leader_uuid: "8e7159623a8e4db2aba75bbce17ca767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.119092 6758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:50.121646 6802 mvcc.cc:205] Tried to move back new op lower bound from 7317042176285786112 to 7317042175977467904. Current Snapshot: MvccSnapshot[applied={T|T < 7317042176285786112}]
I20260810 18:40:50.133211 6788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8e7159623a8e4db2aba75bbce17ca767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.133597 6788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:50.134953 6801 sys_catalog.cc:455] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e7159623a8e4db2aba75bbce17ca767. Latest consensus state: current_term: 1 leader_uuid: "8e7159623a8e4db2aba75bbce17ca767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.135282 6801 sys_catalog.cc:458] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:50.136216 6797 catalog_manager.cc:1347] Generated new cluster ID: e3394408c86f4256994525cdcedb3e1c
I20260810 18:40:50.136317 6797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:50.137264 6758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8e7159623a8e4db2aba75bbce17ca767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.137523 6758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:50.155977 6772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8e7159623a8e4db2aba75bbce17ca767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.156338 6772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:50.157887 6806 mvcc.cc:205] Tried to move back new op lower bound from 7317042176285786112 to 7317042175977467904. Current Snapshot: MvccSnapshot[applied={T|T < 7317042176285786112}]
I20260810 18:40:50.163945 6801 sys_catalog.cc:455] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8e7159623a8e4db2aba75bbce17ca767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7159623a8e4db2aba75bbce17ca767" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 36919 } } peers { permanent_uuid: "e654cebcc55d4236a6f27e7444aec54f" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 42853 } } peers { permanent_uuid: "005448e689d24cd1bb8bf5404027cfa2" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 37633 } } }
I20260810 18:40:50.164184 6801 sys_catalog.cc:458] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:50.178536 6797 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:50.181223 6797 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:50.205134 6797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e7159623a8e4db2aba75bbce17ca767: Generated new TSK 0
I20260810 18:40:50.207127 6797 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:50.214490 6821 catalog_manager.cc:1259] Loaded cluster ID: e3394408c86f4256994525cdcedb3e1c
I20260810 18:40:50.214643 6821 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f: loading cluster ID for follower catalog manager: success
I20260810 18:40:50.219694 6821 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f: acquiring CA information for follower catalog manager: success
I20260810 18:40:50.222235 6821 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e654cebcc55d4236a6f27e7444aec54f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 18:40:50.365567 6755 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.338322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40302 (local address 127.13.139.62:36919)
0810 18:40:50.338564 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.338571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.361898 (+ 23327us) server_negotiation.cc:407] Connection header received
0810 18:40:50.363777 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.363784 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.363896 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.363989 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.365296 (+ 1307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40302: BlockingRecv error: recv got EOF from 127.0.0.1:40302 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260810 18:40:50.369372 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.356104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49850 (local address 127.13.139.60:37633)
0810 18:40:50.356298 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.356307 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.367396 (+ 11089us) server_negotiation.cc:407] Connection header received
0810 18:40:50.367814 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.367821 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.367902 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.367973 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.369073 (+ 1100us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49850: BlockingRecv error: recv got EOF from 127.0.0.1:49850 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260810 18:40:50.371804 6670 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.344608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47312 (local address 127.13.139.61:42853)
0810 18:40:50.344824 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.344830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.366752 (+ 21922us) server_negotiation.cc:407] Connection header received
0810 18:40:50.369924 (+ 3172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.369929 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.370030 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.370102 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.371578 (+ 1476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47312: BlockingRecv error: recv got EOF from 127.0.0.1:47312 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:40:50.423803 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.402910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47328 (local address 127.13.139.61:42853)
0810 18:40:50.403106 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.403112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.416021 (+ 12909us) server_negotiation.cc:407] Connection header received
0810 18:40:50.416303 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.416309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.416527 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.416698 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.417411 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.418582 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.420676 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.421339 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.421451 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.422201 (+ 750us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.422908 (+ 707us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.423055 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.423306 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.423411 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260810 18:40:50.480932 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.471627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49854 (local address 127.13.139.60:37633)
0810 18:40:50.471841 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.471847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.478757 (+ 6910us) server_negotiation.cc:407] Connection header received
0810 18:40:50.479295 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.479301 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.479455 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.479533 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.480692 (+ 1159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49854: BlockingRecv error: recv got EOF from 127.0.0.1:49854 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 18:40:50.528788 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.514130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47344 (local address 127.13.139.61:42853)
0810 18:40:50.514391 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.514398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.521833 (+ 7435us) server_negotiation.cc:407] Connection header received
0810 18:40:50.522357 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.522364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.522491 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.522566 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.523254 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.524456 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.526545 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.527168 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.527269 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.527901 (+ 632us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.528058 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.528122 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.528350 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.528454 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260810 18:40:50.580926 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.571841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49870 (local address 127.13.139.60:37633)
0810 18:40:50.572029 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.572040 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.578880 (+ 6840us) server_negotiation.cc:407] Connection header received
0810 18:40:50.579371 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.579377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.579546 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.579631 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.580675 (+ 1044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49870: BlockingRecv error: recv got EOF from 127.0.0.1:49870 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 18:40:50.634634 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.619352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47346 (local address 127.13.139.61:42853)
0810 18:40:50.619582 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.619588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.628020 (+ 8432us) server_negotiation.cc:407] Connection header received
0810 18:40:50.628260 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.628266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.628350 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.628439 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.629015 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.630162 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.632200 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.632885 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.633014 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.633700 (+ 686us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.633857 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.633925 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.634170 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.634252 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260810 18:40:50.649164 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.646559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49884 (local address 127.13.139.60:37633)
0810 18:40:50.646764 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.646772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.647293 (+ 521us) server_negotiation.cc:407] Connection header received
0810 18:40:50.647636 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.647642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.647745 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.647824 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.648929 (+ 1105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49884: BlockingRecv error: recv got EOF from 127.0.0.1:49884 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 18:40:50.664651 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.657474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47348 (local address 127.13.139.61:42853)
0810 18:40:50.657696 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.657702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.658041 (+ 339us) server_negotiation.cc:407] Connection header received
0810 18:40:50.658219 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.658226 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.658327 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.658432 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.658896 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.660133 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.662188 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.662915 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.663093 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.663529 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.663722 (+ 193us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.663816 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.664030 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.664327 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260810 18:40:50.677758 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.675464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49900 (local address 127.13.139.60:37633)
0810 18:40:50.675709 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.675715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.676260 (+ 545us) server_negotiation.cc:407] Connection header received
0810 18:40:50.676434 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.676439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.676557 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.676671 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.677491 (+ 820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49900: BlockingRecv error: recv got EOF from 127.0.0.1:49900 (error 108)
Metrics: {"server-negotiator.queue_time_us":132}
I20260810 18:40:50.695580 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.689571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47354 (local address 127.13.139.61:42853)
0810 18:40:50.689828 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.689835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.690131 (+ 296us) server_negotiation.cc:407] Connection header received
0810 18:40:50.690348 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.690352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.690414 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.690492 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.690931 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.692100 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.693599 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.694095 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.694232 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.694680 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.694795 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.694907 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.695065 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.695145 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 18:40:50.704900 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.702980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49916 (local address 127.13.139.60:37633)
0810 18:40:50.703173 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.703180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.703567 (+ 387us) server_negotiation.cc:407] Connection header received
0810 18:40:50.703768 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.703773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.703856 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.703963 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.704653 (+ 690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49916: BlockingRecv error: recv got EOF from 127.0.0.1:49916 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 18:40:50.731388 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.725111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47360 (local address 127.13.139.61:42853)
0810 18:40:50.725382 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.725391 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.725822 (+ 431us) server_negotiation.cc:407] Connection header received
0810 18:40:50.726037 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.726042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.726106 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.726187 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.726723 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.727591 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.729554 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.729988 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.730078 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.730668 (+ 590us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.730768 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.730833 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.731022 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.731093 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260810 18:40:50.740104 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.738195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49932 (local address 127.13.139.60:37633)
0810 18:40:50.738428 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.738436 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.738723 (+ 287us) server_negotiation.cc:407] Connection header received
0810 18:40:50.738865 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.738870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.738968 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.739078 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.739854 (+ 776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49932: BlockingRecv error: recv got EOF from 127.0.0.1:49932 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260810 18:40:50.783711 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.776240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47364 (local address 127.13.139.61:42853)
0810 18:40:50.776517 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.776528 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.778394 (+ 1866us) server_negotiation.cc:407] Connection header received
0810 18:40:50.778643 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.778647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.778735 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.778836 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.779270 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.780074 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.781672 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.782274 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.782425 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.782876 (+ 451us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.782996 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.783096 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.783257 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.783340 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260810 18:40:50.797485 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.792633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49936 (local address 127.13.139.60:37633)
0810 18:40:50.792886 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.792896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.796022 (+ 3126us) server_negotiation.cc:407] Connection header received
0810 18:40:50.796226 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.796232 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.796317 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.796432 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.797237 (+ 805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49936: BlockingRecv error: recv got EOF from 127.0.0.1:49936 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 18:40:50.872207 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:50.865310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47378 (local address 127.13.139.61:42853)
0810 18:40:50.865513 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.865519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.866074 (+ 555us) server_negotiation.cc:407] Connection header received
0810 18:40:50.866251 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.866256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.866327 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.866427 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:50.866869 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.867681 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.869596 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:50.870462 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:50.870623 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:50.871219 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:50.871397 (+ 178us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:50.871524 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:50.871689 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 18:40:50.871800 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 18:40:50.882895 6753 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:50.881205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49944 (local address 127.13.139.60:37633)
0810 18:40:50.881428 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:50.881434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:50.881763 (+ 329us) server_negotiation.cc:407] Connection header received
0810 18:40:50.881909 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:50.881913 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:50.881984 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:50.882071 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:50.882725 (+ 654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49944: BlockingRecv error: recv got EOF from 127.0.0.1:49944 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 18:40:50.964152 6770 catalog_manager.cc:1259] Loaded cluster ID: e3394408c86f4256994525cdcedb3e1c
I20260810 18:40:50.964258 6770 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: loading cluster ID for follower catalog manager: success
I20260810 18:40:50.966837 6770 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: acquiring CA information for follower catalog manager: success
I20260810 18:40:50.968611 6770 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 005448e689d24cd1bb8bf5404027cfa2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 18:40:51.020094 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:51.014809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47384 (local address 127.13.139.61:42853)
0810 18:40:51.015072 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:51.015081 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:51.015347 (+ 266us) server_negotiation.cc:407] Connection header received
0810 18:40:51.015658 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:51.015662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:51.015730 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:51.015837 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:51.016249 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.016956 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.018413 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.018826 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.018934 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:51.019285 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:51.019411 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:51.019544 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:51.019696 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 18:40:51.019762 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:40:51.031266 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:51.025993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.13.139.60:37633)
0810 18:40:51.026224 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:51.026231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:51.026415 (+ 184us) server_negotiation.cc:407] Connection header received
0810 18:40:51.026550 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:51.026553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:51.026701 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:51.026796 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:51.027160 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.027928 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.029203 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.029570 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.029657 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:51.030128 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:51.030671 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:51.030773 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:51.030899 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 18:40:51.030959 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 18:40:51.049759 6670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:51.038166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47398 (local address 127.13.139.61:42853)
0810 18:40:51.038394 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:51.038403 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:51.042855 (+ 4452us) server_negotiation.cc:407] Connection header received
0810 18:40:51.043171 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:51.043177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:51.043267 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:51.043335 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:51.044394 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.045141 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.047461 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.048141 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.048243 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:51.049009 (+ 766us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:51.049127 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:51.049203 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:51.049426 (+ 223us) server_negotiation.cc:299] Negotiation successful
0810 18:40:51.049517 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 18:40:51.049854 6753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:51.037825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49964 (local address 127.13.139.60:37633)
0810 18:40:51.040111 (+ 2286us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:51.040133 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:51.043356 (+ 3223us) server_negotiation.cc:407] Connection header received
0810 18:40:51.043567 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:51.043571 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:51.043632 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:51.043725 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:51.044472 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.045594 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.047375 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.048066 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.048206 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:51.049090 (+ 884us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:51.049209 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:51.049305 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:51.049490 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 18:40:51.049569 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 18:40:51.051710 6946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:51.037890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40318 (local address 127.13.139.62:36919)
0810 18:40:51.042031 (+ 4141us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:51.042038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:51.042558 (+ 520us) server_negotiation.cc:407] Connection header received
0810 18:40:51.042933 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:51.042941 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:51.043198 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:51.043378 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:51.044428 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.045594 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.049290 (+ 3696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:51.049933 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:51.050058 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:51.050690 (+ 632us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:51.051009 (+ 319us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:51.051161 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:51.051270 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 18:40:51.051337 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3986,"thread_start_us":3892,"threads_started":1}
I20260810 18:40:51.061023 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6515
I20260810 18:40:51.062333 6579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:51.174441 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6515
I20260810 18:40:51.201465 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6594
I20260810 18:40:51.202622 6661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:51.310192 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6594
I20260810 18:40:51.334537 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6673
I20260810 18:40:51.335729 6744 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:51.442441 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6673
2026-08-10T18:40:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4673 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 18:40:51 dist-test-slave-5k54 krb5kdc[6953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 18:40:51 dist-test-slave-5k54 krb5kdc[6953](info): set up 2 sockets
Aug 10 18:40:51 dist-test-slave-5k54 krb5kdc[6953](info): commencing operation
krb5kdc: starting...
W20260810 18:40:52.638487 13868 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/test-user.keytab.
Aug 10 18:40:52 dist-test-slave-5k54 krb5kdc[6953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T18:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T18:40:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.139.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
Entry for principal kudu/127.13.139.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab.
I20260810 18:40:52.975109 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33261
--webserver_interface=127.13.139.62
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:45237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:33261,127.13.139.61:36225,127.13.139.60:44169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 18:40:53.314642 6968 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 18:40:53.315030 6968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:53.315172 6968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:53.315297 6968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:53.322676 6968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:53.322784 6968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:53.322894 6968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:53.322988 6968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:53.323081 6968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:53.333444 6968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:45237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:33261,127.13.139.61:36225,127.13.139.60:44169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.62.keytab
--principal=kudu/127.13.139.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.62:33261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.139.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:53.334884 6968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:53.336333 6968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:53.348632 6973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:53.349257 6976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:53.349291 6974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:53.349799 6968 server_base.cc:1034] running on GCE node
I20260810 18:40:53.350572 6968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:53.352083 6968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:53.353353 6968 hybrid_clock.cc:648] HybridClock initialized: now 1786387253353282 us; error 54 us; skew 500 ppm
I20260810 18:40:53.353700 6968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:53 dist-test-slave-5k54 krb5kdc[6953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:53.357110 6968 init.cc:377] Logged in from keytab as kudu/127.13.139.62@KRBTEST.COM (short username kudu)
I20260810 18:40:53.358636 6968 webserver.cc:460] Webserver started at http://127.13.139.62:45695/ using document root <none> and password file <none>
I20260810 18:40:53.359334 6968 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:53.359505 6968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:53.359838 6968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:53.362855 6968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data/instance:
uuid: "0f638747ad074d7e804462cfb3501cc3"
format_stamp: "Formatted at 2026-08-10 18:40:53 on dist-test-slave-5k54"
server_key: "fb23a67f778e985c8014b3abc3395e5e"
server_key_iv: "d4090f09fda09f282752d6212bb10a7e"
server_key_version: "encryptionkey@0"
I20260810 18:40:53.363792 6968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/wal/instance:
uuid: "0f638747ad074d7e804462cfb3501cc3"
format_stamp: "Formatted at 2026-08-10 18:40:53 on dist-test-slave-5k54"
server_key: "fb23a67f778e985c8014b3abc3395e5e"
server_key_iv: "d4090f09fda09f282752d6212bb10a7e"
server_key_version: "encryptionkey@0"
I20260810 18:40:53.368837 6968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 18:40:53.372308 6983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:53.373600 6968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 18:40:53.373793 6968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/wal
uuid: "0f638747ad074d7e804462cfb3501cc3"
format_stamp: "Formatted at 2026-08-10 18:40:53 on dist-test-slave-5k54"
server_key: "fb23a67f778e985c8014b3abc3395e5e"
server_key_iv: "d4090f09fda09f282752d6212bb10a7e"
server_key_version: "encryptionkey@0"
I20260810 18:40:53.374009 6968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:53.394766 6968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:53.398787 6968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:53.399076 6968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:53.418134 6968 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.62:33261
I20260810 18:40:53.418154 7041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.62:33261 every 8 connection(s)
I20260810 18:40:53.419555 6968 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/data/info.pb
I20260810 18:40:53.423301 7042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:53.426817 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 6968
I20260810 18:40:53.427043 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-0/wal/instance
I20260810 18:40:53.427541 13868 external_mini_cluster.cc:1428] Setting key d1098c555da4b276aa3e9981e9137474
I20260810 18:40:53.430133 7042 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:53 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:53.453299 7045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.433460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.13.139.62:33261)
0810 18:40:53.435134 (+ 1674us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:53.435142 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:53.435192 (+ 50us) server_negotiation.cc:407] Connection header received
0810 18:40:53.436823 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:53.436829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:53.437085 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:53.437298 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:53.438637 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.439920 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.441296 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.441855 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.442068 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:53.445887 (+ 3819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:53.445896 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:53.445933 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:53.445963 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:53.448809 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:53.449762 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:53.449768 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:53.449770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:53.449943 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:53.450433 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:53.450437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:53.450439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:53.450952 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:53.451115 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:53.451882 (+ 767us) server_negotiation.cc:299] Negotiation successful
0810 18:40:53.452216 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":1462,"thread_start_us":1228,"threads_started":1}
I20260810 18:40:53.453361 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.433460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33261 (local address 127.0.0.1:57188)
0810 18:40:53.434305 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.434359 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:53.436443 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:53.437308 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:53.437315 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:53.438065 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:53.438415 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:53.438433 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.440076 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.440084 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:53.441156 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:53.441168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.442095 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.442103 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:53.442276 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:53.442957 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:53.442979 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:53.445637 (+ 2658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:53.448962 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:53.448979 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:53.448994 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:53.449627 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:53.450075 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:53.450083 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:53.450090 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:53.450314 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:53.451109 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:53.451120 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:53.451480 (+ 360us) client_negotiation.cc:769] Sending connection context
0810 18:40:53.451786 (+ 306us) client_negotiation.cc:240] Negotiation successful
0810 18:40:53.452431 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"mutex_wait_us":83,"thread_start_us":357,"threads_started":1}
I20260810 18:40:53.456487 7042 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:40:53.457640 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.457087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57518)
0810 18:40:53.457298 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.457478 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260810 18:40:53.457916 6986 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
I20260810 18:40:53.459641 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.459151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57524)
0810 18:40:53.459333 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.459467 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 18:40:53.459873 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:36225: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.13.139.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab.
Entry for principal kudu/127.13.139.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab.
I20260810 18:40:53.500837 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:36225
--webserver_interface=127.13.139.61
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab
--principal=kudu/127.13.139.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:45237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:33261,127.13.139.61:36225,127.13.139.60:44169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:40:53.509243 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } attempt: 1
I20260810 18:40:53.510773 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.510201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57530)
0810 18:40:53.510506 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.510633 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 18:40:53.511859 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.511529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57544)
0810 18:40:53.511678 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.511739 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 18:40:53.512056 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:36225: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
I20260810 18:40:53.580314 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } attempt: 2
I20260810 18:40:53.581611 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.581031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57556)
0810 18:40:53.581305 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.581430 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260810 18:40:53.582815 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.582323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57570)
0810 18:40:53.582494 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.582638 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260810 18:40:53.582995 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:36225: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
I20260810 18:40:53.674271 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } attempt: 3
I20260810 18:40:53.675595 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.675024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57574)
0810 18:40:53.675257 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.675375 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260810 18:40:53.676687 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.676255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57590)
0810 18:40:53.676422 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.676523 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260810 18:40:53.676903 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:36225: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
I20260810 18:40:53.820183 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } attempt: 4
I20260810 18:40:53.821583 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.820938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57594)
0810 18:40:53.821280 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.821389 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
I20260810 18:40:53.822635 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.822229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57600)
0810 18:40:53.822391 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.822483 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260810 18:40:53.822866 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.61:36225: Network error: Client connection negotiation failed: client connection to 127.13.139.61:36225: connect: Connection refused (error 111)
W20260810 18:40:53.840718 7049 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 18:40:53.841061 7049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:53.841135 7049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:53.841218 7049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:53.848495 7049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:53.848598 7049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:53.848664 7049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:53.848708 7049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:53.848773 7049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:53.858562 7049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:45237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:33261,127.13.139.61:36225,127.13.139.60:44169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.61.keytab
--principal=kudu/127.13.139.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.61:36225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.139.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:53.859875 7049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:53.861183 7049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:53.873234 7057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:53.873257 7054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:53.873790 7055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:53.874191 7049 server_base.cc:1034] running on GCE node
I20260810 18:40:53.874915 7049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:53.876489 7049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:53.877712 7049 hybrid_clock.cc:648] HybridClock initialized: now 1786387253877638 us; error 43 us; skew 500 ppm
I20260810 18:40:53.878058 7049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:53 dist-test-slave-5k54 krb5kdc[6953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:53.881560 7049 init.cc:377] Logged in from keytab as kudu/127.13.139.61@KRBTEST.COM (short username kudu)
I20260810 18:40:53.883095 7049 webserver.cc:460] Webserver started at http://127.13.139.61:46753/ using document root <none> and password file <none>
I20260810 18:40:53.883917 7049 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:53.884065 7049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:53.884404 7049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:53.887513 7049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data/instance:
uuid: "09226977ba6845bcabe7bc3cb97d30ba"
format_stamp: "Formatted at 2026-08-10 18:40:53 on dist-test-slave-5k54"
server_key: "f5296bd50252070901a4baae527babdd"
server_key_iv: "a2cb6c1fe3173c4726bb7391425559df"
server_key_version: "encryptionkey@0"
I20260810 18:40:53.888336 7049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/wal/instance:
uuid: "09226977ba6845bcabe7bc3cb97d30ba"
format_stamp: "Formatted at 2026-08-10 18:40:53 on dist-test-slave-5k54"
server_key: "f5296bd50252070901a4baae527babdd"
server_key_iv: "a2cb6c1fe3173c4726bb7391425559df"
server_key_version: "encryptionkey@0"
I20260810 18:40:53.893596 7049 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 18:40:53.897085 7067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:53.898443 7049 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 18:40:53.898638 7049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/wal
uuid: "09226977ba6845bcabe7bc3cb97d30ba"
format_stamp: "Formatted at 2026-08-10 18:40:53 on dist-test-slave-5k54"
server_key: "f5296bd50252070901a4baae527babdd"
server_key_iv: "a2cb6c1fe3173c4726bb7391425559df"
server_key_version: "encryptionkey@0"
I20260810 18:40:53.898865 7049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:53.925529 7049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:53.930189 7049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:53.930497 7049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:53.949774 7049 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.61:36225
I20260810 18:40:53.949805 7122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.61:36225 every 8 connection(s)
I20260810 18:40:53.951733 7049 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/data/info.pb
I20260810 18:40:53.953145 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 7049
I20260810 18:40:53.953348 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-1/wal/instance
I20260810 18:40:53.953924 13868 external_mini_cluster.cc:1428] Setting key df0341ff28782d232b8e9084785181f7
I20260810 18:40:53.956418 7123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:53.966409 7123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:53 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.139.60@KRBTEST.COM; defaulting to no policy
I20260810 18:40:53.988790 7127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.969921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57192 (local address 127.13.139.62:33261)
0810 18:40:53.970457 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:53.970462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:53.971664 (+ 1202us) server_negotiation.cc:407] Connection header received
0810 18:40:53.973575 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:53.973581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:53.973682 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:53.973803 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:53.975365 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.976224 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.977896 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.978431 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.978578 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:53.982394 (+ 3816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:53.982400 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:53.982405 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:53.982445 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:53.985442 (+ 2997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:53.986250 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:53.986256 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:53.986261 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:53.986392 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:53.986815 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:53.986821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:53.986825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:53.987146 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:53.987306 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:53.988141 (+ 835us) server_negotiation.cc:299] Negotiation successful
0810 18:40:53.988367 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":297,"threads_started":1}
I20260810 18:40:53.989813 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.970662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33261 (local address 127.0.0.1:57192)
0810 18:40:53.971507 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.971547 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:53.973292 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:53.974059 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:53.974068 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:53.974610 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:53.975151 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:53.975168 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.976405 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.976409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:53.977756 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:53.977768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.978671 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.978679 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:53.978920 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:53.979665 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:53.979688 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:53.982156 (+ 2468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:53.985592 (+ 3436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:53.985601 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:53.985617 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:53.986132 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:53.986506 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:53.986511 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:53.986515 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:53.986701 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:53.987277 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:53.987284 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:53.987773 (+ 489us) client_negotiation.cc:769] Sending connection context
0810 18:40:53.988067 (+ 294us) client_negotiation.cc:240] Negotiation successful
0810 18:40:53.988596 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":315,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.139.60@KRBTEST.COM" created.
I20260810 18:40:53.991770 7123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:53 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:40:54.008589 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.992698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.13.139.61:36225)
0810 18:40:53.993475 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:53.993485 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:53.993521 (+ 36us) server_negotiation.cc:407] Connection header received
0810 18:40:53.993578 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:53.993588 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:53.993835 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:53.993997 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:53.994680 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.996341 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.997452 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.998356 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.998503 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.001571 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.001587 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.001604 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.001651 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.005532 (+ 3881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.006405 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.006412 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.006414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.006527 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.006954 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.006957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.006959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.007302 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.007523 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.007950 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.008272 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":580,"thread_start_us":427,"threads_started":1}
I20260810 18:40:54.008675 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:53.992441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57612)
0810 18:40:53.992680 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:53.992699 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:53.992811 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:53.994007 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:53.994011 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:53.994362 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:53.994504 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:53.994521 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.996476 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.996480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:53.997315 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:53.997326 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:53.998518 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:53.998522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:53.998694 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:53.999297 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:53.999315 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:54.001361 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:54.005678 (+ 4317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.005685 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.005692 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.006265 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.006642 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.006649 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.006655 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.006847 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.007455 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:54.007463 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:54.007645 (+ 182us) client_negotiation.cc:769] Sending connection context
0810 18:40:54.007808 (+ 163us) client_negotiation.cc:240] Negotiation successful
0810 18:40:54.008155 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":38}
I20260810 18:40:54.011299 7123 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:40:54.012729 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.012101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35544)
0810 18:40:54.012339 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.012505 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260810 18:40:54.013058 7071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.014824 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.014334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35550)
0810 18:40:54.014565 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.014676 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260810 18:40:54.015097 7123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.139.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab.
Entry for principal kudu/127.13.139.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab.
I20260810 18:40:54.032799 13868 external_mini_cluster.cc:1326] Running /tmp/dist-test-task4ILylI/build/asan/bin/kudu
/tmp/dist-test-task4ILylI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:44169
--webserver_interface=127.13.139.60
--webserver_port=0
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab
--principal=kudu/127.13.139.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.139.20:45237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.139.62:33261,127.13.139.61:36225,127.13.139.60:44169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 18:40:54.064432 7123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 1
I20260810 18:40:54.065747 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.065155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35564)
0810 18:40:54.065404 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.065549 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 18:40:54.066850 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.066435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35570)
0810 18:40:54.066610 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.066707 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 18:40:54.067121 7123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.122165 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } attempt: 5
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:40:54.135319 7123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 2
I20260810 18:40:54.136468 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.135965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35584)
0810 18:40:54.136177 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.136255 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 18:40:54.137591 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.137223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35598)
0810 18:40:54.137416 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.137480 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260810 18:40:54.138049 7123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.138331 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.123084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57616 (local address 127.13.139.61:36225)
0810 18:40:54.123281 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.123286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.123306 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:40:54.123578 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.123582 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.123644 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.123729 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.124751 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.125488 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.127212 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.127794 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.127911 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.131684 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.131690 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.131695 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.131737 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.135113 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.136052 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.136060 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.136066 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.136250 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.136733 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.136740 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.136744 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.137150 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.137295 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.137829 (+ 534us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.138075 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:40:54.138360 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.122976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:57616)
0810 18:40:54.123209 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.123232 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:54.123373 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:54.123809 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:54.123815 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:54.124335 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:54.124586 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.124599 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.125654 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.125660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.127018 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.127034 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.127962 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.127968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.128212 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.128871 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:54.128895 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:54.131472 (+ 2577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:54.135259 (+ 3787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.135263 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.135266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.135915 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.136393 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.136399 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.136403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.136586 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.137283 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:54.137289 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:54.137480 (+ 191us) client_negotiation.cc:769] Sending connection context
0810 18:40:54.137652 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 18:40:54.138027 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260810 18:40:54.139398 7042 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } has no permanent_uuid. Determining permanent_uuid...
I20260810 18:40:54.140442 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.140088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35610)
0810 18:40:54.140238 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.140308 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 18:40:54.141340 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.141050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35618)
0810 18:40:54.141167 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.141244 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 18:40:54.141552 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.192797 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 1
I20260810 18:40:54.194047 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.193571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35622)
0810 18:40:54.193763 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.193858 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 18:40:54.195161 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.194820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35632)
0810 18:40:54.194989 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.195060 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260810 18:40:54.195542 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.229266 7123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 3
I20260810 18:40:54.230415 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.229950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35636)
0810 18:40:54.230152 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.230253 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 18:40:54.231724 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.231261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35642)
0810 18:40:54.231538 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.231615 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
W20260810 18:40:54.232031 7123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.263767 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 2
I20260810 18:40:54.265230 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.264688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35648)
0810 18:40:54.264963 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.265057 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260810 18:40:54.266295 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.265997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:35662)
0810 18:40:54.266126 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.266191 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 18:40:54.266530 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.372746 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 3
I20260810 18:40:54.373975 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.373480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:40868)
0810 18:40:54.373694 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.373786 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260810 18:40:54.375051 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.374688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:40882)
0810 18:40:54.374873 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.374958 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260810 18:40:54.375329 7042 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
I20260810 18:40:54.375262 7123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 4
I20260810 18:40:54.376248 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.375812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:40894)
0810 18:40:54.376016 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.376110 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 18:40:54.377154 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.376826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:40896)
0810 18:40:54.376987 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.377060 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 18:40:54.377388 7123 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.139.60:44169: Network error: Client connection negotiation failed: client connection to 127.13.139.60:44169: connect: Connection refused (error 111)
W20260810 18:40:54.378698 7132 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 18:40:54.379040 7132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 18:40:54.379123 7132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 18:40:54.379204 7132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 18:40:54.386521 7132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 18:40:54.386602 7132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 18:40:54.386659 7132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 18:40:54.386711 7132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 18:40:54.386770 7132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 18:40:54.396661 7132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.139.20:45237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.139.62:33261,127.13.139.61:36225,127.13.139.60:44169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/krb5kdc/kudu_127.13.139.60.keytab
--principal=kudu/127.13.139.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.139.60:44169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.139.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 10 Aug 2026 17:48:56 UTC on ccycloud.quasar-rratoj.root.comops.site
build id 4578680
ASAN enabled
I20260810 18:40:54.397883 7132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 18:40:54.399163 7132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 18:40:54.411494 7137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:54.411571 7139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 18:40:54.411528 7141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 18:40:54.412467 7132 server_base.cc:1034] running on GCE node
I20260810 18:40:54.413205 7132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 18:40:54.414525 7132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 18:40:54.415740 7132 hybrid_clock.cc:648] HybridClock initialized: now 1786387254415673 us; error 41 us; skew 500 ppm
I20260810 18:40:54.416090 7132 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387254, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 18:40:54.419632 7132 init.cc:377] Logged in from keytab as kudu/127.13.139.60@KRBTEST.COM (short username kudu)
I20260810 18:40:54.421219 7132 webserver.cc:460] Webserver started at http://127.13.139.60:39073/ using document root <none> and password file <none>
I20260810 18:40:54.422070 7132 fs_manager.cc:359] Metadata directory not provided
I20260810 18:40:54.422196 7132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 18:40:54.422554 7132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 18:40:54.426533 7132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data/instance:
uuid: "13c172e8d53e4395ab681236a8ed85a9"
format_stamp: "Formatted at 2026-08-10 18:40:54 on dist-test-slave-5k54"
server_key: "60cf8ee3b694cbb5fc309d668d15d617"
server_key_iv: "0846be8de454821fad8daea1de199711"
server_key_version: "encryptionkey@0"
I20260810 18:40:54.427562 7132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/wal/instance:
uuid: "13c172e8d53e4395ab681236a8ed85a9"
format_stamp: "Formatted at 2026-08-10 18:40:54 on dist-test-slave-5k54"
server_key: "60cf8ee3b694cbb5fc309d668d15d617"
server_key_iv: "0846be8de454821fad8daea1de199711"
server_key_version: "encryptionkey@0"
I20260810 18:40:54.432937 7132 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 18:40:54.436275 7149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 18:40:54.437559 7132 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 18:40:54.437741 7132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data,/tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/wal
uuid: "13c172e8d53e4395ab681236a8ed85a9"
format_stamp: "Formatted at 2026-08-10 18:40:54 on dist-test-slave-5k54"
server_key: "60cf8ee3b694cbb5fc309d668d15d617"
server_key_iv: "0846be8de454821fad8daea1de199711"
server_key_version: "encryptionkey@0"
I20260810 18:40:54.437966 7132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 18:40:54.455663 7132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 18:40:54.459591 7132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 18:40:54.459916 7132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 18:40:54.478694 7132 rpc_server.cc:307] RPC server started. Bound to: 127.13.139.60:44169
I20260810 18:40:54.478785 7208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.139.60:44169 every 8 connection(s)
I20260810 18:40:54.480163 7132 server_base.cc:1166] Dumped server information to /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/data/info.pb
I20260810 18:40:54.483897 7209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 18:40:54.485248 13868 external_mini_cluster.cc:1388] Started /tmp/dist-test-task4ILylI/build/asan/bin/kudu as pid 7132
I20260810 18:40:54.485450 13868 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task4ILylI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786386879896169-13868-0/minicluster-data/master-2/wal/instance
I20260810 18:40:54.486081 13868 external_mini_cluster.cc:1428] Setting key 4ae5a4c99cbee19fd61ab74ca73ffc3d
I20260810 18:40:54.494240 7209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387254, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:54.512334 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.487940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40908 (local address 127.13.139.60:44169)
0810 18:40:54.488742 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.488754 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.488792 (+ 38us) server_negotiation.cc:407] Connection header received
0810 18:40:54.491221 (+ 2429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.491251 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.491813 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.492278 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.494062 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.496089 (+ 2027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.497950 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.499004 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.499149 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.504041 (+ 4892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.504052 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.504066 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.504119 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.507590 (+ 3471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.508333 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.508343 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.508351 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.508546 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.509050 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.509054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.509057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.509769 (+ 712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.510138 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.510543 (+ 405us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.510986 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":369,"threads_started":1}
I20260810 18:40:54.514464 7216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.497272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43124 (local address 127.13.139.62:33261)
0810 18:40:54.498569 (+ 1297us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.498576 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.498596 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:40:54.498657 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.498662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.498754 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.498874 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.500494 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.501189 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.502997 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.503686 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.503814 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.507982 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.507986 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.507990 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.508022 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.511624 (+ 3602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.512336 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.512341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.512344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.512512 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.512935 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.512942 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.512945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.513215 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.513377 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.513833 (+ 456us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.514067 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1170,"thread_start_us":1038,"threads_started":1}
I20260810 18:40:54.514488 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.497220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.62:33261 (local address 127.0.0.1:43124)
0810 18:40:54.498164 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.498236 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:54.498435 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:54.498964 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:54.498968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:54.499902 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:54.500310 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.500333 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.501349 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.501356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.502832 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.502846 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.503949 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.503957 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.504148 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.504861 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:54.504891 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:54.507788 (+ 2897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:54.511771 (+ 3983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.511780 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.511785 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.512202 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.512654 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.512658 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.512662 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.512814 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.513362 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:54.513370 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:54.513547 (+ 177us) client_negotiation.cc:769] Sending connection context
0810 18:40:54.513724 (+ 177us) client_negotiation.cc:240] Negotiation successful
0810 18:40:54.514044 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":307,"threads_started":1}
I20260810 18:40:54.516039 7209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387254, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.62@KRBTEST.COM
I20260810 18:40:54.530279 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.516721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.61:36225 (local address 127.0.0.1:46480)
0810 18:40:54.516974 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.516992 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:54.517095 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:54.517394 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:54.517410 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:54.517749 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:54.517877 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.517885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.519026 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.519031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.520259 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.520271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.521040 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.521046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.521225 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.521743 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:54.521758 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:54.524144 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:54.527867 (+ 3723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.527872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.527874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.528255 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.528672 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.528676 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.528680 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.528860 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.529449 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:54.529454 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:54.529620 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 18:40:54.529786 (+ 166us) client_negotiation.cc:240] Negotiation successful
0810 18:40:54.529998 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260810 18:40:54.530690 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.516857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.13.139.61:36225)
0810 18:40:54.517034 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.517038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.517054 (+ 16us) server_negotiation.cc:407] Connection header received
0810 18:40:54.517199 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.517203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.517258 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.517336 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.518030 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.518888 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.520400 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.520883 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.521021 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.524327 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.524340 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.524344 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.524376 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.527734 (+ 3358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.528377 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.528382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.528387 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.528557 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.528969 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.528972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.528974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.529304 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.529476 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.529887 (+ 411us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.530104 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 18:40:54.531348 7216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.515272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43136 (local address 127.13.139.62:33261)
0810 18:40:54.515461 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.515466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.515584 (+ 118us) server_negotiation.cc:407] Connection header received
0810 18:40:54.515779 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.515784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.515870 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.515967 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.517477 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.518342 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.519888 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.520276 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.520428 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.525018 (+ 4590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.525026 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.525030 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.525072 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.528360 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.529217 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.529222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.529224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.529376 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.529792 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.529797 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.529800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.530173 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.530450 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.530822 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.531051 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:40:54.531683 7209 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387254, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.60@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.139.61@KRBTEST.COM
I20260810 18:40:54.545456 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.532601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40912 (local address 127.13.139.60:44169)
0810 18:40:54.532757 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.532761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.532819 (+ 58us) server_negotiation.cc:407] Connection header received
0810 18:40:54.532994 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.532999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.533066 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.533138 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.534049 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.534801 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.536139 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.536624 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.536716 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.539883 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.539888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.539891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.539918 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.542640 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.543358 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.543362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.543365 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.543536 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.543965 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.543977 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.543980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.544233 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.544338 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.544841 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.545226 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":90,"server-negotiator.queue_time_us":52}
I20260810 18:40:54.545485 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.532592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:40912)
0810 18:40:54.532749 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.532768 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:54.532878 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:54.533205 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:54.533210 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:54.533726 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:54.533909 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.533924 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.534932 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.534941 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.536006 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.536018 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.536767 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.536774 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.536984 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.537520 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:54.537543 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:54.539711 (+ 2168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:54.542767 (+ 3056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.542774 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.542778 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.543239 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.543645 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.543652 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.543656 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.543819 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.544353 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:54.544358 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:54.544517 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 18:40:54.544699 (+ 182us) client_negotiation.cc:240] Negotiation successful
0810 18:40:54.545047 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 18:40:54.549259 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.533650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46492 (local address 127.13.139.61:36225)
0810 18:40:54.533795 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.533799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.533813 (+ 14us) server_negotiation.cc:407] Connection header received
0810 18:40:54.533974 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.533997 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.534067 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.534162 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.535408 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.536204 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.537756 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.538159 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.538248 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.543081 (+ 4833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.543089 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.543096 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.543135 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.546421 (+ 3286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.547225 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.547230 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.547233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.547393 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.547795 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.547800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.547803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.548160 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.548460 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.548696 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.548937 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 18:40:54.551865 7209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: Bootstrap starting.
I20260810 18:40:54.552544 7042 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 4
I20260810 18:40:54.554399 13868 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 18:40:54.556123 7209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: Neither blocks nor log segments found. Creating new log.
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.62@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:40:54.560598 7209 log.cc:824] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:54.557439 7012 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0f638747ad074d7e804462cfb3501cc3"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43136
I20260810 18:40:54.564254 7209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: No bootstrap required, opened a new log
I20260810 18:40:54.568019 7044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.553144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:40914)
0810 18:40:54.553315 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.553335 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:54.553477 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:54.554027 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:54.554036 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:54.554428 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:54.554637 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.554647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.555655 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.555661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.556691 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.556702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.557543 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.557549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.557777 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.558379 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:54.558399 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:54.561016 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:54.565146 (+ 4130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.565151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.565155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.565678 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.566094 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.566100 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.566104 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.566276 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.566931 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:54.566937 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:54.567138 (+ 201us) client_negotiation.cc:769] Sending connection context
0810 18:40:54.567293 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 18:40:54.567626 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 18:40:54.568027 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.553582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40914 (local address 127.13.139.60:44169)
0810 18:40:54.553769 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.553773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.553786 (+ 13us) server_negotiation.cc:407] Connection header received
0810 18:40:54.553826 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.553829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.553887 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.553995 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.554770 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.555519 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.556835 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.557381 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.557509 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.561224 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.561232 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.561244 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.561291 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.565001 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.565797 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.565802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.565806 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.565970 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.566387 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.566392 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.566395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.566797 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.566973 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.567407 (+ 434us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.567649 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:40:54.573979 7042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3: Bootstrap starting.
I20260810 18:40:54.574733 7209 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.575158 7209 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13c172e8d53e4395ab681236a8ed85a9, State: Initialized, Role: FOLLOWER
I20260810 18:40:54.575685 7209 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.576716 7218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.577137 7218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:54.577993 7209 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:54.578145 7042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:54.579550 7042 log.cc:824] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:54.583173 7042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3: No bootstrap required, opened a new log
W20260810 18:40:54.588193 7233 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 18:40:54.588332 7233 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 18:40:54.590978 7042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.591349 7042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f638747ad074d7e804462cfb3501cc3, State: Initialized, Role: FOLLOWER
I20260810 18:40:54.591847 7042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.593034 7236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.593748 7236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:54.594055 7042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:54.594120 7012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 18:40:54.594298 7012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:54.586024 7132 master_runner.cc:186] Error getting master registration for 127.13.139.62:33261: OK, instance_id { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" instance_seqno: 1786387253412734 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 18:40:54.597440 7132 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 18:40:54.597643 7012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.599663 7183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0f638747ad074d7e804462cfb3501cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "13c172e8d53e4395ab681236a8ed85a9"
I20260810 18:40:54.600121 7183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:54.603711 7183 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f638747ad074d7e804462cfb3501cc3 in term 1.
I20260810 18:40:54.603587 7012 leader_election.cc:288] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [CANDIDATE]: Term 1 election: Requested vote from peers 09226977ba6845bcabe7bc3cb97d30ba (127.13.139.61:36225), 13c172e8d53e4395ab681236a8ed85a9 (127.13.139.60:44169)
I20260810 18:40:54.604331 6987 leader_election.cc:302] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f638747ad074d7e804462cfb3501cc3, 13c172e8d53e4395ab681236a8ed85a9; no voters:
I20260810 18:40:54.611052 7236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 18:40:54.612013 7236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [term 1 LEADER]: Becoming Leader. State: Replica: 0f638747ad074d7e804462cfb3501cc3, State: Running, Role: LEADER
I20260810 18:40:54.612536 7236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.619412 7246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f638747ad074d7e804462cfb3501cc3. Latest consensus state: current_term: 1 leader_uuid: "0f638747ad074d7e804462cfb3501cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.619894 7246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:54.628676 7252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 18:40:54.645502 7252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 18:40:54.652617 7262 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260810 18:40:54.652830 6989 tablet.cc:2369] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:54.670428 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.631100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.13.139.61:36225)
0810 18:40:54.631331 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.631339 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.632551 (+ 1212us) server_negotiation.cc:407] Connection header received
0810 18:40:54.633967 (+ 1416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.633975 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.634110 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.634196 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.639683 (+ 5487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.641064 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.655353 (+ 14289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.656302 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.656430 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.660758 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.660766 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.660771 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.660818 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.664659 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.666175 (+ 1516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.666180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.666184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.666338 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.668548 (+ 2210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.668554 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.668559 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.668966 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.669198 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.669819 (+ 621us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.670069 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 18:40:54.659611 6968 master_runner.cc:186] Error getting master registration for 127.13.139.61:36225: OK, instance_id { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" instance_seqno: 1786387253944310 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 18:40:54.670866 6968 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 18:40:54.675103 7216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.630139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43144 (local address 127.13.139.62:33261)
0810 18:40:54.630340 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.630347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.630520 (+ 173us) server_negotiation.cc:407] Connection header received
0810 18:40:54.631861 (+ 1341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.631867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.631951 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.632046 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.636825 (+ 4779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.637998 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.641860 (+ 3862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.642548 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.642646 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.649928 (+ 7282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.649935 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.649939 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.649981 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.669968 (+ 19987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.671745 (+ 1777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.671751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.671755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.671920 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.672457 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.672463 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.672466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.672848 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.673143 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.673859 (+ 716us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.674340 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:40:54.677048 7123 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } attempt: 5
I20260810 18:40:54.688387 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.633225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40920 (local address 127.13.139.60:44169)
0810 18:40:54.633417 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.633424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.662883 (+ 29459us) server_negotiation.cc:407] Connection header received
0810 18:40:54.663196 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.663213 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.663311 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.663386 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.665184 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.666330 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.671169 (+ 4839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.671866 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.671963 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.676149 (+ 4186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.676155 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.676159 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.676200 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.681243 (+ 5043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.683664 (+ 2421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.683674 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.683681 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.683893 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.684944 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.684953 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.684960 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.685472 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.685806 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.687459 (+ 1653us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.687797 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 10 18:40:54 dist-test-slave-5k54 krb5kdc[6953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786387253, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.139.61@KRBTEST.COM for kudu/127.13.139.60@KRBTEST.COM
I20260810 18:40:54.704478 7183 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [term 1 FOLLOWER]: Refusing update from remote peer 0f638747ad074d7e804462cfb3501cc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:54.705783 7246 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:54.710542 7128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.677583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.139.60:44169 (local address 127.0.0.1:40922)
0810 18:40:54.678006 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0810 18:40:54.678026 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 18:40:54.678124 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 18:40:54.689550 (+ 11426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 18:40:54.689559 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 18:40:54.690239 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0810 18:40:54.690540 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.690559 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.692490 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.692497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.694015 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 18:40:54.694033 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.696341 (+ 2308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.696349 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 18:40:54.696623 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.697370 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 18:40:54.697395 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 18:40:54.700639 (+ 3244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 18:40:54.707243 (+ 6604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.707250 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.707253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.707882 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.708429 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 18:40:54.708434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 18:40:54.708438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 18:40:54.708617 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 18:40:54.709370 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 18:40:54.709376 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 18:40:54.709541 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 18:40:54.709703 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 18:40:54.710061 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298}
I20260810 18:40:54.712060 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:54.678335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40922 (local address 127.13.139.60:44169)
0810 18:40:54.689102 (+ 10767us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:54.689111 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:54.689132 (+ 21us) server_negotiation.cc:407] Connection header received
0810 18:40:54.689196 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:54.689205 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:54.689307 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:54.690740 (+ 1433us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:54.690948 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.692306 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.694598 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:54.696076 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:54.697050 (+ 974us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:54.701003 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 18:40:54.701010 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 18:40:54.701015 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 18:40:54.701054 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 18:40:54.707056 (+ 6002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.708060 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.708065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.708069 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.708241 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 18:40:54.708788 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 18:40:54.708793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 18:40:54.708796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 18:40:54.709199 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 18:40:54.711109 (+ 1910us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:54.711246 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 18:40:54.711546 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10624,"thread_start_us":13296,"threads_started":1}
W20260810 18:40:54.712185 7156 tablet.cc:2369] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 18:40:54.720808 7123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba: Bootstrap starting.
I20260810 18:40:54.725673 7123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba: Neither blocks nor log segments found. Creating new log.
I20260810 18:40:54.727133 7123 log.cc:824] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba: Log is configured to *not* fsync() on all Append() calls
I20260810 18:40:54.730847 7218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f638747ad074d7e804462cfb3501cc3. Latest consensus state: current_term: 1 leader_uuid: "0f638747ad074d7e804462cfb3501cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.731267 7218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:54.737869 7263 mvcc.cc:205] Tried to move back new op lower bound from 7317042195235966976 to 7317042194906202112. Current Snapshot: MvccSnapshot[applied={T|T < 7317042195235966976}]
I20260810 18:40:54.738875 7265 mvcc.cc:205] Tried to move back new op lower bound from 7317042195235966976 to 7317042194906202112. Current Snapshot: MvccSnapshot[applied={T|T < 7317042195235966976}]
I20260810 18:40:54.740643 7218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f638747ad074d7e804462cfb3501cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.741014 7218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:54.743439 7123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba: No bootstrap required, opened a new log
I20260810 18:40:54.747311 7246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f638747ad074d7e804462cfb3501cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.747676 7246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:54.749310 7252 catalog_manager.cc:1347] Generated new cluster ID: 65f74e0726b14d889710a66b2c99fb17
I20260810 18:40:54.749430 7252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 18:40:54.766655 7123 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.767306 7123 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09226977ba6845bcabe7bc3cb97d30ba, State: Initialized, Role: FOLLOWER
I20260810 18:40:54.769819 7123 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } }
I20260810 18:40:54.774715 7252 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 18:40:54.780876 7252 catalog_manager.cc:1504] Loading token signing keys...
I20260810 18:40:54.788635 7123 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [sys.catalog]: configured and running, proceeding with master startup.
I20260810 18:40:54.789139 7096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [term 0 FOLLOWER]: Advancing to term 1
I20260810 18:40:54.782794 7270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.790563 7270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:54.794298 7096 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [term 1 FOLLOWER]: Refusing update from remote peer 0f638747ad074d7e804462cfb3501cc3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 18:40:54.795228 7097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0f638747ad074d7e804462cfb3501cc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "09226977ba6845bcabe7bc3cb97d30ba"
I20260810 18:40:54.799316 7097 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f638747ad074d7e804462cfb3501cc3 in term 1.
I20260810 18:40:54.799811 7236 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 18:40:54.842743 7270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f638747ad074d7e804462cfb3501cc3. Latest consensus state: current_term: 1 leader_uuid: "0f638747ad074d7e804462cfb3501cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.843129 7270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:54.844520 7278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f638747ad074d7e804462cfb3501cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.845054 7278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba [sys.catalog]: This master's current role is: FOLLOWER
I20260810 18:40:54.864888 7236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f638747ad074d7e804462cfb3501cc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f638747ad074d7e804462cfb3501cc3" member_type: VOTER last_known_addr { host: "127.13.139.62" port: 33261 } } peers { permanent_uuid: "09226977ba6845bcabe7bc3cb97d30ba" member_type: VOTER last_known_addr { host: "127.13.139.61" port: 36225 } } peers { permanent_uuid: "13c172e8d53e4395ab681236a8ed85a9" member_type: VOTER last_known_addr { host: "127.13.139.60" port: 44169 } } }
I20260810 18:40:54.865274 7236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3 [sys.catalog]: This master's current role is: LEADER
I20260810 18:40:54.877068 7252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f638747ad074d7e804462cfb3501cc3: Generated new TSK 0
I20260810 18:40:54.878907 7252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 18:40:54.901984 7288 catalog_manager.cc:1259] Loaded cluster ID: 65f74e0726b14d889710a66b2c99fb17
I20260810 18:40:54.902127 7288 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba: loading cluster ID for follower catalog manager: success
I20260810 18:40:54.906177 7288 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba: acquiring CA information for follower catalog manager: success
I20260810 18:40:54.908875 7288 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 09226977ba6845bcabe7bc3cb97d30ba: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 18:40:55.019089 13868 mini_kdc.cc:348] Time spent kdestroy: real 0.112s user 0.000s sys 0.032s
W20260810 18:40:55.072180 7216 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.060787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43152 (local address 127.13.139.62:33261)
0810 18:40:55.061102 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.061110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.069459 (+ 8349us) server_negotiation.cc:407] Connection header received
0810 18:40:55.070525 (+ 1066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.070531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.070619 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.070700 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.071924 (+ 1224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43152: BlockingRecv error: recv got EOF from 127.0.0.1:43152 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260810 18:40:55.077205 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.064439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40932 (local address 127.13.139.60:44169)
0810 18:40:55.064640 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.064646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.073783 (+ 9137us) server_negotiation.cc:407] Connection header received
0810 18:40:55.075753 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.075760 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.075885 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.075968 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.076950 (+ 982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40932: BlockingRecv error: recv got EOF from 127.0.0.1:40932 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 18:40:55.079918 7129 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.074584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46502 (local address 127.13.139.61:36225)
0810 18:40:55.074829 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.074835 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.075479 (+ 644us) server_negotiation.cc:407] Connection header received
0810 18:40:55.077987 (+ 2508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.077993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.078074 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.078142 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.079676 (+ 1534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46502: BlockingRecv error: recv got EOF from 127.0.0.1:46502 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:40:55.128059 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.112217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46516 (local address 127.13.139.61:36225)
0810 18:40:55.112432 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.112440 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.119892 (+ 7452us) server_negotiation.cc:407] Connection header received
0810 18:40:55.120446 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.120452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.120708 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.120864 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.121577 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.122769 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.124928 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.125631 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.125726 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.126495 (+ 769us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.127211 (+ 716us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.127327 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.127616 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.127714 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260810 18:40:55.186036 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.171977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40934 (local address 127.13.139.60:44169)
0810 18:40:55.172179 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.172186 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.184084 (+ 11898us) server_negotiation.cc:407] Connection header received
0810 18:40:55.184375 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.184381 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.184514 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.184617 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.185751 (+ 1134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40934: BlockingRecv error: recv got EOF from 127.0.0.1:40934 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 18:40:55.234778 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.220059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46526 (local address 127.13.139.61:36225)
0810 18:40:55.220276 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.220288 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.227768 (+ 7480us) server_negotiation.cc:407] Connection header received
0810 18:40:55.228366 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.228372 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.228475 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.228540 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.229232 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.230380 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.232460 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.233151 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.233246 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.233886 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.234061 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.234123 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.234371 (+ 248us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.234462 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260810 18:40:55.251363 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.249122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40940 (local address 127.13.139.60:44169)
0810 18:40:55.249299 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.249305 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.249817 (+ 512us) server_negotiation.cc:407] Connection header received
0810 18:40:55.250023 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.250029 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.250131 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.250250 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.251124 (+ 874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40940: BlockingRecv error: recv got EOF from 127.0.0.1:40940 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:40:55.264238 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.257252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46538 (local address 127.13.139.61:36225)
0810 18:40:55.257436 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.257442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.257963 (+ 521us) server_negotiation.cc:407] Connection header received
0810 18:40:55.258150 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.258157 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.258249 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.258354 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.258799 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.260042 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.261998 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.262666 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.262785 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.263301 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.263536 (+ 235us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.263640 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.263809 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.263895 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260810 18:40:55.274183 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.271773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40948 (local address 127.13.139.60:44169)
0810 18:40:55.271947 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.271953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.272730 (+ 777us) server_negotiation.cc:407] Connection header received
0810 18:40:55.272908 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.272913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.273005 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.273109 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.273944 (+ 835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40948: BlockingRecv error: recv got EOF from 127.0.0.1:40948 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 18:40:55.287858 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.282012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46542 (local address 127.13.139.61:36225)
0810 18:40:55.282282 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.282288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.282544 (+ 256us) server_negotiation.cc:407] Connection header received
0810 18:40:55.282720 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.282724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.282789 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.282888 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.283347 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.284162 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.285947 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.286576 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.286679 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.287171 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.287272 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.287342 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.287524 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.287590 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
W20260810 18:40:55.296363 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.294241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40962 (local address 127.13.139.60:44169)
0810 18:40:55.294520 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.294529 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.294839 (+ 310us) server_negotiation.cc:407] Connection header received
0810 18:40:55.295106 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.295110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.295184 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.295316 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.296107 (+ 791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40962: BlockingRecv error: recv got EOF from 127.0.0.1:40962 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
I20260810 18:40:55.313349 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.307545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46548 (local address 127.13.139.61:36225)
0810 18:40:55.307737 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.307744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.308134 (+ 390us) server_negotiation.cc:407] Connection header received
0810 18:40:55.308291 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.308296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.308384 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.308486 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.308838 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.309925 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.311299 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.312049 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.312173 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.312567 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.312716 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.312821 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.312949 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.313027 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260810 18:40:55.321590 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.319467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40970 (local address 127.13.139.60:44169)
0810 18:40:55.319672 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.319679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.320034 (+ 355us) server_negotiation.cc:407] Connection header received
0810 18:40:55.320223 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.320228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.320304 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.320395 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.321297 (+ 902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40970: BlockingRecv error: recv got EOF from 127.0.0.1:40970 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
I20260810 18:40:55.348282 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.341892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46552 (local address 127.13.139.61:36225)
0810 18:40:55.342096 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.342102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.342544 (+ 442us) server_negotiation.cc:407] Connection header received
0810 18:40:55.342725 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.342731 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.342845 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.342947 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.343352 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.344623 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.346183 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.346849 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.346968 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.347507 (+ 539us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.347642 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.347739 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.347887 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.347978 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260810 18:40:55.356827 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.354691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40986 (local address 127.13.139.60:44169)
0810 18:40:55.354954 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.354962 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.355255 (+ 293us) server_negotiation.cc:407] Connection header received
0810 18:40:55.355494 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.355503 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.355594 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.355679 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.356592 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40986: BlockingRecv error: recv got EOF from 127.0.0.1:40986 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 18:40:55.398653 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.392619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46556 (local address 127.13.139.61:36225)
0810 18:40:55.392863 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.392870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.393238 (+ 368us) server_negotiation.cc:407] Connection header received
0810 18:40:55.393407 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.393414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.393538 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.393654 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.394087 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.395317 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.396712 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.397367 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.397506 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.397876 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.398012 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.398111 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.398242 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.398323 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260810 18:40:55.411295 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.409304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40990 (local address 127.13.139.60:44169)
0810 18:40:55.409476 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.409480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.409833 (+ 353us) server_negotiation.cc:407] Connection header received
0810 18:40:55.410039 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.410043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.410115 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.410195 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.411078 (+ 883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40990: BlockingRecv error: recv got EOF from 127.0.0.1:40990 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 18:40:55.486215 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.479044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46568 (local address 127.13.139.61:36225)
0810 18:40:55.479235 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.479241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.479883 (+ 642us) server_negotiation.cc:407] Connection header received
0810 18:40:55.480088 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.480094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.480188 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.480291 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.480811 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.482051 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.484158 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.484849 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.484978 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.485445 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.485588 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.485671 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.485824 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.485919 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260810 18:40:55.504314 7214 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 18:40:55.496894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40994 (local address 127.13.139.60:44169)
0810 18:40:55.497088 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.497094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.502800 (+ 5706us) server_negotiation.cc:407] Connection header received
0810 18:40:55.503009 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.503013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.503110 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.503190 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 18:40:55.504093 (+ 903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40994: BlockingRecv error: recv got EOF from 127.0.0.1:40994 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 18:40:55.590554 7233 catalog_manager.cc:1259] Loaded cluster ID: 65f74e0726b14d889710a66b2c99fb17
I20260810 18:40:55.590658 7233 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: loading cluster ID for follower catalog manager: success
I20260810 18:40:55.593326 7233 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: acquiring CA information for follower catalog manager: success
I20260810 18:40:55.595180 7233 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 13c172e8d53e4395ab681236a8ed85a9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 18:40:55.640763 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.636036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46582 (local address 127.13.139.61:36225)
0810 18:40:55.636226 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.636231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.636600 (+ 369us) server_negotiation.cc:407] Connection header received
0810 18:40:55.636761 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.636765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.636836 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.636931 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.637322 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.638029 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.639318 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.639729 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.639819 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.640181 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.640286 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.640364 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.640487 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.640550 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 18:40:55.652184 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.646644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41010 (local address 127.13.139.60:44169)
0810 18:40:55.646832 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.646840 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.647286 (+ 446us) server_negotiation.cc:407] Connection header received
0810 18:40:55.647391 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.647395 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.647651 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.647745 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.648167 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.648845 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.650135 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.650544 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.650646 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.651096 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.651705 (+ 609us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.651811 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.651914 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.651983 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 18:40:55.668041 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.658218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41014 (local address 127.13.139.60:44169)
0810 18:40:55.658464 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.658473 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.661543 (+ 3070us) server_negotiation.cc:407] Connection header received
0810 18:40:55.661789 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.661795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.661887 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.661967 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.662734 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.663798 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.666040 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.666634 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.666768 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.667313 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.667455 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.667555 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.667713 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.667786 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 18:40:55.669030 7413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.658084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43160 (local address 127.13.139.62:33261)
0810 18:40:55.661277 (+ 3193us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.661284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.661304 (+ 20us) server_negotiation.cc:407] Connection header received
0810 18:40:55.662125 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.662135 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.662525 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.663363 (+ 838us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.663574 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.664565 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.666344 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.666968 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.667111 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.667710 (+ 599us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.668118 (+ 408us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.668622 (+ 504us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.668672 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.668747 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3008,"thread_start_us":2047,"threads_started":1}
I20260810 18:40:55.669082 7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 18:40:55.661725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46592 (local address 127.13.139.61:36225)
0810 18:40:55.662001 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 18:40:55.662009 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 18:40:55.663017 (+ 1008us) server_negotiation.cc:407] Connection header received
0810 18:40:55.663183 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 18:40:55.663188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 18:40:55.663298 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 18:40:55.663390 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 18:40:55.664046 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.664756 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.666884 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 18:40:55.667523 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 18:40:55.667649 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 18:40:55.668291 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 18:40:55.668401 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 18:40:55.668457 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 18:40:55.668724 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 18:40:55.668799 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 18:40:55.673895 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 6968
I20260810 18:40:55.675338 7035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:55.784854 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 6968
I20260810 18:40:55.811038 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 7049
I20260810 18:40:55.812179 7118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:55.920578 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 7049
I20260810 18:40:55.943502 13868 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task4ILylI/build/asan/bin/kudu pid 7132
I20260810 18:40:55.944638 7204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260810 18:40:56.052999 13868 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task4ILylI/build/asan/bin/kudu with pid 7132
2026-08-10T18:40:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4609 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9282 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (376081 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST